Sep 25 15:57:38 devstack cinder-volume[76067]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 15:57:38 devstack cinder-volume[76067]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 15:57:38 devstack cinder-volume[76067]: we strongly recommend against using it for new projects. Sep 25 15:57:38 devstack cinder-volume[76067]: If you are already using Eventlet, we recommend migrating to a different Sep 25 15:57:38 devstack cinder-volume[76067]: framework. For more detail see Sep 25 15:57:38 devstack cinder-volume[76067]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 15:57:38 devstack cinder-volume[76067]: import eventlet # noqa Sep 25 15:57:41 devstack cinder-volume[76067]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76067) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 15:57:41 devstack cinder-volume[76067]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76067) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 15:57:41 devstack cinder-volume[76067]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76067) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 15:57:42 devstack cinder-volume[76067]: INFO dbcounter [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Registered counter for database cinder Sep 25 15:57:42 devstack cinder-volume[76067]: DEBUG oslo_db.sqlalchemy.engines [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76067) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:57:42 devstack cinder-volume[76067]: DEBUG dbcounter [-] [76067] Writer thread running {{(pid=76067) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 15:57:42 devstack cinder-volume[76067]: INFO cinder.rpc [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 15:57:42 devstack cinder-volume[76067]: INFO cinder.rpc [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 15:57:42 devstack cinder-volume[76067]: DEBUG oslo_db.sqlalchemy.engines [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76067) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:57:42 devstack cinder-volume[76067]: INFO cinder.volume.manager [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Determined volume DB was empty at startup. Sep 25 15:57:42 devstack cinder-volume[76067]: DEBUG cinder.volume.manager [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76067) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 15:57:43 devstack cinder-volume[76067]: INFO cinder.volume.manager [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 15:57:43 devstack cinder-volume[76067]: WARNING stevedore.named [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 15:57:43 devstack cinder-volume[76067]: WARNING castellan.key_manager [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 15:57:43 devstack cinder-volume[76067]: WARNING cinder.keymgr.conf_key_mgr [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG cinder.volume.drivers.lvm [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76067) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_concurrency.processutils [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_concurrency.processutils [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] CMD "cinder-rtstool verify" returned: 0 in 0.565s {{(pid=76067) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_db.sqlalchemy.engines [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76067) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:57:43 devstack cinder-volume[76067]: INFO cinder.rpc [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 15:57:43 devstack cinder-volume[76067]: INFO cinder.rpc [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 15:57:43 devstack cinder-volume[76067]: WARNING stevedore.named [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 15:57:43 devstack cinder-volume[76067]: WARNING castellan.key_manager [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 15:57:43 devstack cinder-volume[76067]: INFO cinder.volume.manager [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_db.sqlalchemy.engines [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76067) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:57:43 devstack cinder-volume[76067]: INFO oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Starting 1 workers Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Started child 76227 {{(pid=76067) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Full set of CONF: {{(pid=76067) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] ******************************************************************************** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Configuration options gathered from: {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] ================================================================================ {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] allow_availability_zone_fallback = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] allow_compression_on_image_upload = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] allowed_direct_url_schemes = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] api_rate_limit = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] auth_strategy = keystone {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] az_cache_duration = 3600 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_availability_zone = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_host = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_stats_polling_interval = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76227]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backup_api_class = cinder.backup.api.API {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backup_name_template = backup-%s {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backup_use_same_host = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backup_use_temp_snapshot = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] chap_password = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] chap_username = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cinder_internal_tenant_project_id = 61e90edf17aa4970befb4c7bac4ecbca {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cinder_internal_tenant_user_id = 986906818c184f1aa4a5959867195c4f {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cloned_volume_same_az = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cluster = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] compression_format = gzip {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] compute_api_class = cinder.compute.nova.API {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] config_dir = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] config_source = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] control_exchange = openstack {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] debug = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] default_availability_zone = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] default_group_type = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] default_volume_type = lvmdriver-1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] disk_geometry = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] driver_client_cert = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] driver_client_cert_key = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] driver_data_namespace = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] driver_ssl_cert_path = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] driver_ssl_cert_verify = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] driver_use_ssl = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] enable_force_upload = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] enable_new_services = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] enable_unsupported_driver = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] enforce_multipath_for_image_xfer = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] filter_function = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_api_insecure = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_api_ssl_compression = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_ca_certificates_file = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_catalog_info = image:glance:publicURL {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_certfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_keyfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_num_retries = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance_request_timeout = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] goodness_function = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] graceful_shutdown_timeout = 5 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] group_api_class = cinder.group.api.API {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] host = devstack {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_compress_on_upload = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_conversion_address_space_limit = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_conversion_cpu_limit = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_conversion_disable = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_introspection_address_space_limit = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_introspection_cpu_limit = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_upload_use_cinder_backend = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_upload_use_internal_tenant = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_volume_cache_enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_volume_cache_max_count = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] image_volume_cache_max_size_gb = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] init_host_max_objects_retrieval = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] instance_format = [instance: %(uuid)s] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] iscsi_target_flags = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] iscsi_write_cache = on {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] iser_helper = tgtadm {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] iser_ip_address = 192.168.122.235 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] iser_port = 3260 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] log_color = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] log_config_append = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] log_dir = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] log_file = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] log_options = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] log_rotate_interval = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] log_rotate_interval_type = days {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] log_rotation_type = none {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] max_age = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] max_logfile_count = 30 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] max_logfile_size_mb = 200 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] max_over_subscription_ratio = 20.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] message_reap_interval = 86400 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] message_ttl = 2592000 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] migration_create_volume_timeout_secs = 300 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] monkey_patch = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] monkey_patch_modules = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] my_ip = 192.168.122.235 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] no_snapshot_gb_quota = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] num_iser_scan_tries = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] num_shell_tries = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] num_volume_device_scan_tries = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] nvmeof_conn_info_version = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] nvmet_ns_id = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] nvmet_port_id = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] osapi_max_limit = 1000 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] osapi_volume_ext_list = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] osapi_volume_listen_port = 8776 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] osapi_volume_use_ssl = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] osapi_volume_workers = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] per_volume_size_limit = -1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] periodic_fuzzy_delay = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] periodic_interval = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] public_endpoint = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] publish_errors = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] quota_backup_gigabytes = 1000 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] quota_backups = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] quota_gigabytes = 1000 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] quota_groups = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] quota_snapshots = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] quota_volumes = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] rate_limit_burst = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] rate_limit_except_level = CRITICAL {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] rate_limit_interval = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] reinit_driver_count = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] replication_device = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] report_discard_supported = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] report_interval = 120 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] reservation_clean_interval = 86400 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] reservation_expire = 86400 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] reserved_image_namespaces = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] reserved_percentage = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] rpc_response_timeout = 120 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] run_external_periodic_tasks = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] scst_target_driver = iscsi {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] scst_target_iqn_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_down_time = 720 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] shell_completion = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] snapshot_name_template = snapshot-%s {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] snapshot_same_host = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] split_loggers = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] state_path = /opt/stack/data/cinder {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] storage_availability_zone = nova {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] storage_protocol = iSCSI {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] syslog_log_facility = LOG_USER {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] target_helper = lioadm {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] target_ip_address = 192.168.122.235 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] target_port = 3260 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76227]: INFO cinder.volume.manager [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] target_protocol = iscsi {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] target_secondary_ip_addresses = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] trace_flags = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] transport_url = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] until_refresh = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] use_chap_auth = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] use_default_quota_class = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] use_journal = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] use_json = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] use_multipath_for_image_xfer = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] use_stderr = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] use_syslog = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] verify_glance_signatures = enabled {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_api_class = cinder.volume.api.API {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_backend_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_clear = zero {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_clear_ionice = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_clear_size = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_copy_bps_limit = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_dd_blocksize = 1M {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_name_template = volume-%s {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_service_inithost_offload = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volume_usage_audit_period = month {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] zoning_mode = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_concurrency.disable_process_locking = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.auth_section = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.auth_type = password {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.auth_version = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.cache = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.certfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.include_service_catalog = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.insecure = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.interface = public {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.keyfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_password = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcache_username = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.region_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.service_type = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.backend = dogpile.cache.null {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.backend_argument = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.backend_expiration_time = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.config_prefix = cache.oslo {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.debug_cache_backend = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.enable_retry_client = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.enable_socket_keepalive = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.expiration_time = 600 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.hashclient_retry_attempts = 2 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.memcache_dead_retry = 300 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.memcache_pool_maxsize = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.memcache_sasl_enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.password = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.proxies = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.redis_db = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.redis_server = localhost:6379 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.retry_attempts = 2 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.retry_delay = 0.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.socket_keepalive_count = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.socket_keepalive_idle = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.socket_keepalive_interval = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.socket_timeout = 1.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.tls_allowed_ciphers = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.tls_cafile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.tls_certfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.tls_enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.tls_keyfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cache.username = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] coordination.backend_url = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.asyncio_connection = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.asyncio_slave_connection = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.backend = sqlalchemy {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.connection = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.connection_debug = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.connection_parameters = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.connection_recycle_time = 3600 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.connection_trace = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.db_inc_retry_interval = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.db_max_retries = 20 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.db_max_retry_interval = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.db_retry_interval = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.max_overflow = 50 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.max_pool_size = 5 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.max_retries = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.mysql_wsrep_sync_wait = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.pool_timeout = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.retry_interval = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.slave_connection = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.sqlite_synchronous = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.synchronous_reader = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] database.use_db_reconnect = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_tracing.insecure = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.connection_string = messaging:// {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.es_doc_type = notification {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.es_scroll_size = 10000 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.es_scroll_time = 2m {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.filter_error_trace = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.hmac_keys = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.sentinel_service_name = mymaster {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.socket_timeout = 0.1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.trace_requests = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler.trace_sqlalchemy = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler_jaeger.process_tags = {} {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:43 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler_jaeger.service_name_prefix = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] profiler_otlp.service_name_prefix = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.enforce_new_defaults = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.policy_default_rule = default {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.policy_file = policy.yaml {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] privsep_osbrick.group = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] privsep_osbrick.helper_command = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] privsep_osbrick.user = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cinder_sys_admin.group = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cinder_sys_admin.helper_command = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] cinder_sys_admin.user = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.auth_section = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.auth_type = password {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.cafile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.certfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.collect_timing = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.insecure = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.keyfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.send_service_user_token = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.split_loggers = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.timeout = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.tls_ciphers = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] service_user.tls_min_version = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.auth_section = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.auth_type = password {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.certfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.collect_timing = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.insecure = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.keyfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.region_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.split_loggers = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.timeout = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.tls_ciphers = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] glance.tls_min_version = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.backend_availability_zone = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.chap_password = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.chap_username = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.disk_geometry = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.driver_client_cert = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.driver_client_cert_key = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.driver_data_namespace = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.driver_use_ssl = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.extra_capabilities = {} {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.filter_function = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.goodness_function = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.iscsi_target_flags = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.iscsi_write_cache = on {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.iser_helper = tgtadm {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.iser_port = 3260 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack sudo[76231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.lvm_share_target = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack sudo[76231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.lvm_type = auto {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.num_shell_tries = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.replication_device = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.report_discard_supported = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.reserved_percentage = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.target_helper = tgtadm {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.target_port = 3260 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.target_protocol = iscsi {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.trace_flags = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.unique_fqdn_network = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.use_chap_auth = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volume_backend_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volume_clear = zero {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volume_clear_ionice = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volume_clear_size = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_reports.file_event_handler = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_reports.log_dir = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.backend_host = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.chap_password = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.chap_username = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.disk_geometry = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.driver_client_cert = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.extra_capabilities = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.filter_function = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.goodness_function = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.iser_helper = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.iser_ip_address = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.iser_port = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.lvm_share_target = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.lvm_type = auto {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.num_shell_tries = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.replication_device = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.report_discard_supported = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.reserved_percentage = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.scst_target_driver = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.storage_protocol = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.target_helper = lioadm {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.target_ip_address = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.target_port = 3260 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.trace_flags = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.use_chap_auth = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volume_clear = zero {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volume_clear_size = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] lvmdriver-1.volumes_dir = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.ssl = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_notifications.driver = [] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_notifications.retry = -1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] key_manager.fixed_key = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.barbican_api_version = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.barbican_endpoint = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.barbican_endpoint_type = public {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.barbican_region_name = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.cafile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.certfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.collect_timing = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.insecure = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.keyfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.number_of_retries = 60 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.retry_delay = 1 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.send_service_user_token = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.split_loggers = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.timeout = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.tls_ciphers = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.tls_min_version = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.verify_ssl = True {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican.verify_ssl_path = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.auth_section = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.auth_type = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.cafile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.certfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.collect_timing = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.insecure = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.keyfile = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.split_loggers = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.timeout = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.tls_ciphers = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] barbican_service_user.tls_min_version = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.approle_role_id = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.approle_secret_id = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.auth_method = approle {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.auth_path = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.kv_mountpoint = secret {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.kv_path = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.kv_version = 2 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.namespace = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.root_token_id = **** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.ssl_ca_crt_file = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.timeout = 60.0 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.token_file = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.token_role = None {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.use_ssl = False {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:57:44 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] ******************************************************************************** {{(pid=76067) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 15:57:44 devstack sudo[76231]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:44 devstack sudo[76367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:57:44 devstack sudo[76367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:44 devstack sudo[76367]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 15:57:44 devstack cinder-volume[76227]: INFO cinder.brick.local_dev.lvm [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:44 devstack sudo[76463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:57:44 devstack sudo[76463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:44 devstack sudo[76463]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG cinder.brick.local_dev.lvm [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76227) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 15:57:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:44 devstack sudo[76564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:57:44 devstack sudo[76564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:45 devstack sudo[76564]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:45 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.565s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:45 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:45 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:45 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:45 devstack sudo[76790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:57:45 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:45 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:45 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.387s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:45 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:45 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:45 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:45 devstack sudo[76872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 15:57:45 devstack sudo[76872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:46 devstack sudo[76872]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:46 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.284s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:46 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:46 devstack sudo[76912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:57:46 devstack sudo[76912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:46 devstack sudo[76912]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:46 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:46 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:46 devstack sudo[76959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:57:46 devstack sudo[76959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:46 devstack sudo[76959]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:46 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:46 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:46 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:57:46 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:47 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.385s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:47 devstack sudo[77052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:57:47 devstack sudo[77052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:47 devstack sudo[77052]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:47 devstack sudo[77056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:57:47 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:47 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:47 devstack cinder-volume[76227]: INFO cinder.volume.drivers.lvm [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:47 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:47 devstack sudo[77060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:57:47 devstack sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:48 devstack sudo[77060]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:48 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:48 devstack cinder-volume[76227]: DEBUG cinder.volume.drivers.lvm [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Updating volume stats {{(pid=76227) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:57:48 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:48 devstack sudo[77063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:57:48 devstack sudo[77063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:48 devstack sudo[77063]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:48 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:48 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:48 devstack sudo[77072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:57:48 devstack sudo[77072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:48 devstack sudo[77072]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:48 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:48 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:48 devstack sudo[77076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:57:48 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:49 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:49 devstack sudo[77079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:57:49 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:49 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:49 devstack cinder-volume[76227]: INFO cinder.volume.driver [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG cinder.volume.driver [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76227) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG oslo_db.sqlalchemy.engines [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76227) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG dbcounter [-] [76227] Writer thread running {{(pid=76227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG cinder.db.api [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Building query based on filter {{(pid=76227) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG cinder.image.image_utils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76227) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1328}} Sep 25 15:57:49 devstack cinder-volume[76227]: INFO cinder.keymgr.migration [None req-cb3e39f8-77f2-4a36-bf08-f410ec1cbf94 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG cinder.volume.drivers.lvm [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Updating volume stats {{(pid=76227) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:49 devstack sudo[77084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:57:49 devstack sudo[77084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:49 devstack sudo[77084]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:49 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:49 devstack sudo[77087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:57:49 devstack sudo[77087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:50 devstack sudo[77087]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:50 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:50 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:50 devstack sudo[77090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:57:50 devstack sudo[77090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:50 devstack sudo[77090]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:50 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.348s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:50 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:50 devstack sudo[77093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:57:50 devstack sudo[77093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:50 devstack sudo[77093]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:50 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:50 devstack cinder-volume[76227]: DEBUG cinder.manager [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Notifying Schedulers of capabilities ... {{(pid=76227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 15:57:50 devstack cinder-volume[76227]: INFO cinder.volume.manager [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Driver initialization completed successfully. Sep 25 15:57:50 devstack cinder-volume[76227]: INFO cinder.manager [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Initiating service 2 cleanup Sep 25 15:57:50 devstack cinder-volume[76227]: INFO cinder.manager [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Service 2 cleanup completed. Sep 25 15:57:50 devstack cinder-volume[76227]: DEBUG cinder.service [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Creating RPC server for service cinder-volume {{(pid=76227) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 15:57:50 devstack cinder-volume[76227]: DEBUG cinder.service [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76227) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 15:57:51 devstack cinder-volume[76227]: INFO cinder.volume.manager [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 15:57:51 devstack cinder-volume[76227]: DEBUG cinder.volume.drivers.lvm [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Updating volume stats {{(pid=76227) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:57:51 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:51 devstack sudo[77098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:57:51 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:51 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:51 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.360s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:51 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:51 devstack sudo[77101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:57:51 devstack sudo[77101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:51 devstack sudo[77101]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:51 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:51 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:51 devstack sudo[77104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:57:51 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:51 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:51 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:51 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:57:52 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:57:52 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:57:52 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Sep 25 15:57:52 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:57:52 devstack cinder-volume[76227]: INFO cinder.volume.manager [None req-49e3918d-a657-4143-a70c-354221b1ad45 None None] Driver post RPC initialization completed successfully. Sep 25 15:57:53 devstack cinder-volume[76067]: DEBUG dbcounter [-] [76067] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76067) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 15:58:02 devstack cinder-volume[76227]: DEBUG dbcounter [-] [76227] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 15:58:02 devstack cinder-volume[76227]: DEBUG dbcounter [-] [76227] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 15:58:43 devstack cinder-volume[76227]: DEBUG oslo_service.periodic_task [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 15:58:43 devstack cinder-volume[76227]: DEBUG cinder.volume.drivers.lvm [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Updating volume stats {{(pid=76227) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:58:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:43 devstack sudo[78944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:43 devstack sudo[78944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:43 devstack sudo[78944]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:43 devstack sudo[78947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:43 devstack sudo[78947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:43 devstack sudo[78947]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:43 devstack sudo[78950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:43 devstack sudo[78950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:44 devstack sudo[78950]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:44 devstack sudo[78953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:44 devstack sudo[78953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:44 devstack sudo[78953]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:44 devstack cinder-volume[76227]: DEBUG cinder.manager [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Notifying Schedulers of capabilities ... {{(pid=76227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 15:58:44 devstack cinder-volume[76227]: DEBUG oslo_service.periodic_task [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running periodic task VolumeManager._thread_info {{(pid=76227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 15:58:44 devstack cinder-volume[76227]: DEBUG cinder.volume.manager [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] thread count: 6 {{(pid=76227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 15:58:44 devstack cinder-volume[76227]: DEBUG cinder.volume.manager [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] thread info: [<_MainThread(MainThread, started 125194995155072)>, , , , , ] {{(pid=76227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:00:02 devstack cinder-volume[76227]: DEBUG dbcounter [-] [76227] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:00:43 devstack cinder-volume[76227]: DEBUG oslo_service.periodic_task [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:00:43 devstack cinder-volume[76227]: DEBUG cinder.volume.drivers.lvm [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Updating volume stats {{(pid=76227) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:00:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:43 devstack sudo[84066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:00:43 devstack sudo[84066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:43 devstack sudo[84066]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:43 devstack sudo[84078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:00:43 devstack sudo[84078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:43 devstack sudo[84078]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:43 devstack sudo[84081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:00:43 devstack sudo[84081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:44 devstack sudo[84081]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:44 devstack sudo[84104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:00:44 devstack sudo[84104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:44 devstack sudo[84104]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:44 devstack cinder-volume[76227]: DEBUG cinder.manager [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Notifying Schedulers of capabilities ... {{(pid=76227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:00:44 devstack cinder-volume[76227]: DEBUG oslo_service.periodic_task [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running periodic task VolumeManager._thread_info {{(pid=76227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:00:44 devstack cinder-volume[76227]: DEBUG cinder.volume.manager [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] thread count: 6 {{(pid=76227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:00:44 devstack cinder-volume[76227]: DEBUG cinder.volume.manager [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] thread info: [<_MainThread(MainThread, started 125194995155072)>, , , , , ] {{(pid=76227) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:01:43 devstack cinder-volume[76227]: DEBUG oslo_service.periodic_task [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76227) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:01:43 devstack cinder-volume[76227]: DEBUG cinder.volume.drivers.lvm [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Updating volume stats {{(pid=76227) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:01:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:43 devstack sudo[85378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:01:43 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:43 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:43 devstack sudo[85381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:01:43 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:43 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:43 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:43 devstack sudo[85394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:01:43 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:44 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:44 devstack sudo[85398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:01:44 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:44 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:44 devstack cinder-volume[76227]: DEBUG oslo_concurrency.processutils [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:44 devstack cinder-volume[76227]: DEBUG cinder.manager [None req-30508032-6798-45f0-b468-3e79dbc1b8d9 None None] Notifying Schedulers of capabilities ... {{(pid=76227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:02:02 devstack cinder-volume[76227]: DEBUG dbcounter [-] [76227] Writing DB stats cinder:SELECT=1 {{(pid=76227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:02:02 devstack cinder-volume[76227]: DEBUG dbcounter [-] [76227] Writing DB stats cinder:UPDATE=1 {{(pid=76227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:02:22 devstack cinder-volume[76067]: INFO oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Caught SIGTERM, stopping children Sep 25 16:02:22 devstack cinder-volume[76067]: DEBUG oslo_concurrency.lockutils [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Acquiring lock "singleton_lock" {{(pid=76067) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:02:22 devstack cinder-volume[76067]: DEBUG oslo_concurrency.lockutils [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Acquired lock "singleton_lock" {{(pid=76067) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:02:22 devstack cinder-volume[76067]: DEBUG oslo_concurrency.lockutils [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Releasing lock "singleton_lock" {{(pid=76067) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:02:22 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Stop services. {{(pid=76067) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 16:02:22 devstack cinder-volume[76067]: DEBUG oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Killing children. {{(pid=76067) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 16:02:22 devstack cinder-volume[76067]: INFO oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Waiting on 1 children to exit Sep 25 16:02:26 devstack cinder-volume[76227]: DEBUG oslo_concurrency.lockutils [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Acquiring lock "singleton_lock" {{(pid=76227) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:02:26 devstack cinder-volume[76227]: DEBUG oslo_concurrency.lockutils [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Acquired lock "singleton_lock" {{(pid=76227) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:02:26 devstack cinder-volume[76227]: DEBUG oslo_concurrency.lockutils [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Releasing lock "singleton_lock" {{(pid=76227) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:02:26 devstack cinder-volume[76227]: WARNING amqp [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:02:26 devstack cinder-volume[76227]: WARNING amqp [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:02:26 devstack cinder-volume[76067]: INFO oslo_service.backend._eventlet.service [None req-8299a643-2e80-44cc-b7ea-e6f74d7c952f None None] Child 76227 exited with status 0 Sep 25 16:02:26 devstack cinder-volume[86254]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 16:02:26 devstack cinder-volume[86254]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:02:26 devstack cinder-volume[86254]: we strongly recommend against using it for new projects. Sep 25 16:02:26 devstack cinder-volume[86254]: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:02:26 devstack cinder-volume[86254]: framework. For more detail see Sep 25 16:02:26 devstack cinder-volume[86254]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:02:26 devstack cinder-volume[86254]: import eventlet # noqa Sep 25 16:02:28 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:02:28 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:02:28 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:02:29 devstack cinder-volume[86254]: INFO dbcounter [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Registered counter for database cinder Sep 25 16:02:29 devstack cinder-volume[86254]: DEBUG oslo_db.sqlalchemy.engines [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:02:29 devstack cinder-volume[86254]: DEBUG dbcounter [-] [86254] Writer thread running {{(pid=86254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:02:29 devstack cinder-volume[86254]: INFO cinder.rpc [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 16:02:29 devstack cinder-volume[86254]: INFO cinder.rpc [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 16:02:29 devstack cinder-volume[86254]: DEBUG oslo_db.sqlalchemy.engines [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:02:30 devstack cinder-volume[86254]: INFO cinder.volume.manager [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Determined volume DB was empty at startup. Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG cinder.volume.manager [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86254) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 16:02:30 devstack cinder-volume[86254]: INFO cinder.volume.manager [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 16:02:30 devstack cinder-volume[86254]: WARNING stevedore.named [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:02:30 devstack cinder-volume[86254]: WARNING castellan.key_manager [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:02:30 devstack cinder-volume[86254]: WARNING cinder.keymgr.conf_key_mgr [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:02:30 devstack cinder-volume[86254]: INFO cinder.volume.manager [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_db.sqlalchemy.engines [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:02:30 devstack cinder-volume[86254]: INFO oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Starting 1 workers Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Started child 86476 {{(pid=86254) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Full set of CONF: {{(pid=86254) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] ******************************************************************************** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Configuration options gathered from: {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] ================================================================================ {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] allow_availability_zone_fallback = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] allow_compression_on_image_upload = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] allowed_direct_url_schemes = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] api_rate_limit = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] auth_strategy = keystone {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_availability_zone = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_host = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_stats_polling_interval = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backup_api_class = cinder.backup.api.API {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backup_name_template = backup-%s {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backup_use_same_host = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backup_use_temp_snapshot = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] chap_password = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86476]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] chap_username = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cinder_internal_tenant_project_id = 61e90edf17aa4970befb4c7bac4ecbca {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cinder_internal_tenant_user_id = 986906818c184f1aa4a5959867195c4f {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cluster = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] compression_format = gzip {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] compute_api_class = cinder.compute.nova.API {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] config_dir = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] config_source = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] control_exchange = openstack {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] debug = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] default_availability_zone = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] default_group_type = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] default_volume_type = QuobyteHD {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] disk_geometry = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] driver_client_cert = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] driver_client_cert_key = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] driver_data_namespace = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] driver_ssl_cert_path = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] driver_ssl_cert_verify = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] driver_use_ssl = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] enable_new_services = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] enable_unsupported_driver = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] enabled_backends = ['QuobyteHD'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] enforce_multipath_for_image_xfer = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] filter_function = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_api_insecure = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_api_ssl_compression = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_ca_certificates_file = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_catalog_info = image:glance:publicURL {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_certfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_keyfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_num_retries = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance_request_timeout = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] goodness_function = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] graceful_shutdown_timeout = 5 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] group_api_class = cinder.group.api.API {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] host = devstack {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_compress_on_upload = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_conversion_address_space_limit = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_conversion_cpu_limit = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_conversion_disable = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_introspection_address_space_limit = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_introspection_cpu_limit = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_upload_use_cinder_backend = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_upload_use_internal_tenant = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_volume_cache_enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_volume_cache_max_count = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] image_volume_cache_max_size_gb = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] init_host_max_objects_retrieval = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] instance_format = [instance: %(uuid)s] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] iscsi_target_flags = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] iscsi_write_cache = on {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] iser_helper = tgtadm {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] iser_ip_address = 192.168.122.235 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] iser_port = 3260 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] log_color = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] log_config_append = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] log_dir = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] log_file = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] log_options = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] log_rotate_interval = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] log_rotate_interval_type = days {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] log_rotation_type = none {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] max_age = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] max_logfile_count = 30 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] max_logfile_size_mb = 200 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] max_over_subscription_ratio = 20.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] message_reap_interval = 86400 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] message_ttl = 2592000 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] migration_create_volume_timeout_secs = 300 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] monkey_patch = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] monkey_patch_modules = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] my_ip = 192.168.122.235 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] no_snapshot_gb_quota = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] num_iser_scan_tries = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] num_shell_tries = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] num_volume_device_scan_tries = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] nvmeof_conn_info_version = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] nvmet_ns_id = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] nvmet_port_id = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] osapi_max_limit = 1000 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] osapi_volume_ext_list = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] osapi_volume_listen_port = 8776 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] osapi_volume_use_ssl = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] osapi_volume_workers = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] per_volume_size_limit = -1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] periodic_fuzzy_delay = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] periodic_interval = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] public_endpoint = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] publish_errors = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] quota_backup_gigabytes = 1000 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] quota_backups = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] quota_gigabytes = 1000 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] quota_groups = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] quota_snapshots = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] quota_volumes = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] rate_limit_burst = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] rate_limit_except_level = CRITICAL {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] rate_limit_interval = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] reinit_driver_count = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] replication_device = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] report_discard_supported = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] report_interval = 120 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] reservation_clean_interval = 86400 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] reservation_expire = 86400 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] reserved_image_namespaces = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] reserved_percentage = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] rpc_response_timeout = 120 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] run_external_periodic_tasks = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] scst_target_driver = iscsi {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] scst_target_iqn_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_down_time = 720 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] shell_completion = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] snapshot_name_template = snapshot-%s {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] split_loggers = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] state_path = /opt/stack/data/cinder {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] storage_availability_zone = nova {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86476]: INFO cinder.volume.manager [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] storage_protocol = iSCSI {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.remotefs [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86476) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] syslog_log_facility = LOG_USER {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] target_helper = lioadm {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] target_ip_address = 192.168.122.235 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] target_port = 3260 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] target_protocol = iscsi {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] target_secondary_ip_addresses = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] trace_flags = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] transport_url = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] until_refresh = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] use_chap_auth = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] use_default_quota_class = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] use_journal = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] use_json = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] use_multipath_for_image_xfer = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] use_stderr = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] use_syslog = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] verify_glance_signatures = enabled {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_api_class = cinder.volume.api.API {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_backend_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_clear = zero {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_clear_ionice = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_clear_size = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_copy_bps_limit = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_dd_blocksize = 1M {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_name_template = volume-%s {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_service_inithost_offload = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volume_usage_audit_period = month {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] zoning_mode = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_concurrency.disable_process_locking = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.auth_section = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.auth_type = password {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.auth_version = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.cache = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.certfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.include_service_catalog = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.insecure = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.interface = public {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.keyfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_password = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcache_username = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.region_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.service_type = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.backend = dogpile.cache.null {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.backend_argument = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.backend_expiration_time = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.config_prefix = cache.oslo {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.debug_cache_backend = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.enable_retry_client = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.enable_socket_keepalive = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.expiration_time = 600 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.hashclient_retry_attempts = 2 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.memcache_dead_retry = 300 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.memcache_pool_maxsize = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.memcache_sasl_enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.password = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.proxies = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.redis_db = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.redis_server = localhost:6379 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.retry_attempts = 2 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.retry_delay = 0.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.socket_keepalive_count = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.socket_keepalive_idle = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.socket_keepalive_interval = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.socket_timeout = 1.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.tls_allowed_ciphers = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.tls_cafile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.tls_certfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.tls_enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.tls_keyfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cache.username = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] coordination.backend_url = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.asyncio_connection = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.asyncio_slave_connection = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.backend = sqlalchemy {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.connection = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.connection_debug = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.connection_parameters = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.connection_recycle_time = 3600 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.connection_trace = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.db_inc_retry_interval = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.db_max_retries = 20 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.db_max_retry_interval = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.db_retry_interval = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.max_overflow = 50 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.max_pool_size = 5 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.max_retries = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.mysql_wsrep_sync_wait = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.pool_timeout = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.retry_interval = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.slave_connection = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.sqlite_synchronous = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.synchronous_reader = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] database.use_db_reconnect = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_tracing.insecure = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.connection_string = messaging:// {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.es_doc_type = notification {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.es_scroll_size = 10000 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.es_scroll_time = 2m {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.filter_error_trace = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.hmac_keys = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.sentinel_service_name = mymaster {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.socket_timeout = 0.1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.trace_requests = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler.trace_sqlalchemy = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler_jaeger.process_tags = {} {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler_jaeger.service_name_prefix = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] profiler_otlp.service_name_prefix = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.enforce_new_defaults = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.policy_default_rule = default {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.policy_file = policy.yaml {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] privsep_osbrick.group = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] privsep_osbrick.helper_command = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] privsep_osbrick.user = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cinder_sys_admin.group = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cinder_sys_admin.helper_command = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] cinder_sys_admin.user = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.auth_section = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.auth_type = password {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.cafile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.certfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.collect_timing = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.insecure = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86476) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.keyfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.send_service_user_token = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.split_loggers = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.timeout = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.tls_ciphers = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] service_user.tls_min_version = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.auth_section = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.auth_type = password {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.certfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.collect_timing = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.insecure = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.keyfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.region_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.split_loggers = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.timeout = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86476]: WARNING cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.tls_ciphers = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86476]: WARNING cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] glance.tls_min_version = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.backend_availability_zone = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.chap_password = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Running cmd (subprocess): mount.quobyte {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.chap_username = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.disk_geometry = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.driver_client_cert = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.driver_client_cert_key = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.driver_data_namespace = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.driver_use_ssl = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.extra_capabilities = {} {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.filter_function = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.goodness_function = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.iscsi_target_flags = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.iscsi_write_cache = on {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.iser_helper = tgtadm {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.iser_port = 3260 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_host = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_login = admin {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_mount_options = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_password = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_private_key = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_share_path = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.num_shell_tries = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.quobyte_volume_url = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.replication_device = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.report_discard_supported = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.reserved_percentage = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.target_helper = tgtadm {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.target_port = 3260 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.target_protocol = iscsi {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.trace_flags = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.unique_fqdn_network = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.use_chap_auth = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.volume_backend_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.volume_clear = zero {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.volume_clear_ionice = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.volume_clear_size = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_reports.file_event_handler = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_reports.log_dir = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.backend_availability_zone = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.backend_host = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.chap_password = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.chap_username = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.chiscsi_conf = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.disk_geometry = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.driver_client_cert = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.driver_data_namespace = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.driver_use_ssl = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.extra_capabilities = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.filter_function = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.goodness_function = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.iser_helper = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.iser_ip_address = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.iser_port = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.iser_target_prefix = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_host = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_login = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_mount_options = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_password = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_private_key = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_share_path = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_ssh_port = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.num_shell_tries = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.nvmet_port_id = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.replication_device = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.report_discard_supported = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.reserved_percentage = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.scst_target_driver = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.storage_protocol = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.target_helper = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.target_ip_address = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.target_port = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.target_prefix = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.target_protocol = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.trace_flags = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.use_chap_auth = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.volume_clear = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.volume_clear_size = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] QuobyteHD.volumes_dir = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.ssl = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_notifications.driver = [] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_notifications.retry = -1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] key_manager.fixed_key = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.barbican_api_version = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.barbican_endpoint = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.barbican_endpoint_type = public {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.barbican_region_name = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.cafile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.certfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.collect_timing = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.insecure = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.keyfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.number_of_retries = 60 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.retry_delay = 1 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.send_service_user_token = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.split_loggers = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.timeout = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.tls_ciphers = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.tls_min_version = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.verify_ssl = True {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican.verify_ssl_path = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.auth_section = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.auth_type = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.cafile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.certfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.collect_timing = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.insecure = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.keyfile = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.split_loggers = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.timeout = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.tls_ciphers = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] barbican_service_user.tls_min_version = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.approle_role_id = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.approle_secret_id = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.auth_method = approle {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.auth_path = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.kv_mountpoint = secret {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.kv_path = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.kv_version = 2 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.namespace = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.root_token_id = **** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.ssl_ca_crt_file = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.timeout = 60.0 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.token_file = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.token_role = None {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.use_ssl = False {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:30 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] ******************************************************************************** {{(pid=86254) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 16:02:30 devstack quobyte-client[86481]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 16:02:30 devstack quobyte-client[86481]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] CMD "mount.quobyte" returned: 1 in 0.100s {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=86476) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:02:30 devstack cinder-volume[86476]: INFO cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 ... Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 -c /etc/quobyte/client-cinder.cfg {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:30 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 -c /etc/quobyte/client-cinder.cfg Sep 25 16:02:30 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:30 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.405s {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:30 devstack cinder-volume[86476]: INFO cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 succeeded Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=86476) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.417s {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:02:30 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:30 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:02:30 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:31 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.352s {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:31 devstack cinder-volume[86476]: INFO cinder.volume.driver [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.volume.driver [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3254661560059, 'free_capacity_gb': 1775.3254661560059, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86476) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_db.sqlalchemy.engines [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG dbcounter [-] [86476] Writer thread running {{(pid=86476) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.db.api [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Building query based on filter {{(pid=86476) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.image.image_utils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86476) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1328}} Sep 25 16:02:31 devstack cinder-volume[86476]: INFO cinder.keymgr.migration [None req-ad894559-1912-46be-8aee-f6beb6c3c6b8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=86476) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=86476) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:31 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:02:31 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:31 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.281s {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.manager [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Notifying Schedulers of capabilities ... {{(pid=86476) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:02:31 devstack cinder-volume[86476]: INFO cinder.volume.manager [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Driver initialization completed successfully. Sep 25 16:02:31 devstack cinder-volume[86476]: INFO cinder.manager [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Initiating service 3 cleanup Sep 25 16:02:31 devstack cinder-volume[86476]: INFO cinder.manager [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Service 3 cleanup completed. Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.service [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Creating RPC server for service cinder-volume {{(pid=86476) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.service [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86476) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 16:02:31 devstack cinder-volume[86476]: INFO cinder.volume.manager [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=86476) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.quobyte [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=86476) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:02:31 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:31 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:02:31 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:32 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:32 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.376s {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:32 devstack cinder-volume[86476]: INFO cinder.volume.manager [None req-219dcb07-731b-4f41-850a-26cf0bb376f7 None None] Driver post RPC initialization completed successfully. Sep 25 16:02:37 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-f9909080-2e61-4eff-a206-866ae64276cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:02:37 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-f9909080-2e61-4eff-a206-866ae64276cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:02:37 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.quobyte [None req-f9909080-2e61-4eff-a206-866ae64276cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=86476) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:02:37 devstack cinder-volume[86476]: DEBUG cinder.volume.drivers.quobyte [None req-f9909080-2e61-4eff-a206-866ae64276cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=86476) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:02:37 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-f9909080-2e61-4eff-a206-866ae64276cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86476) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:02:37 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-f9909080-2e61-4eff-a206-866ae64276cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:37 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:02:37 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:37 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:37 devstack cinder-volume[86476]: DEBUG oslo_concurrency.processutils [None req-f9909080-2e61-4eff-a206-866ae64276cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.272s {{(pid=86476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:37 devstack cinder-volume[86476]: DEBUG cinder.manager [None req-f9909080-2e61-4eff-a206-866ae64276cc None None] Notifying Schedulers of capabilities ... {{(pid=86476) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:02:40 devstack cinder-volume[86254]: INFO oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Caught SIGTERM, stopping children Sep 25 16:02:40 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Acquiring lock "singleton_lock" {{(pid=86254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:02:40 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Acquired lock "singleton_lock" {{(pid=86254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:02:40 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Releasing lock "singleton_lock" {{(pid=86254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:02:40 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Stop services. {{(pid=86254) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 16:02:40 devstack cinder-volume[86254]: DEBUG oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Killing children. {{(pid=86254) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 16:02:40 devstack cinder-volume[86254]: INFO oslo_service.backend._eventlet.service [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Waiting on 1 children to exit Sep 25 16:02:41 devstack cinder-volume[86476]: DEBUG dbcounter [-] [86476] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86476) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:02:42 devstack cinder-volume[86476]: DEBUG dbcounter [-] [86476] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86476) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:02:45 devstack cinder-volume[86476]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 25 16:02:45 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Acquiring lock "singleton_lock" {{(pid=86476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:02:45 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Acquired lock "singleton_lock" {{(pid=86476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:02:45 devstack cinder-volume[86476]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Releasing lock "singleton_lock" {{(pid=86476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:02:45 devstack cinder-volume[86476]: WARNING amqp [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:02:45 devstack cinder-volume[86476]: WARNING amqp [None req-8d9b0a52-2b6c-4dc6-84ea-844ac8b92569 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:02:45 devstack cinder-volume[87017]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 16:02:45 devstack cinder-volume[87017]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:02:45 devstack cinder-volume[87017]: we strongly recommend against using it for new projects. Sep 25 16:02:45 devstack cinder-volume[87017]: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:02:45 devstack cinder-volume[87017]: framework. For more detail see Sep 25 16:02:45 devstack cinder-volume[87017]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:02:45 devstack cinder-volume[87017]: import eventlet # noqa Sep 25 16:02:48 devstack cinder-volume[87017]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87017) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:02:48 devstack cinder-volume[87017]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87017) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:02:48 devstack cinder-volume[87017]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87017) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:02:49 devstack cinder-volume[87017]: INFO dbcounter [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Registered counter for database cinder Sep 25 16:02:49 devstack cinder-volume[87017]: DEBUG oslo_db.sqlalchemy.engines [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87017) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:02:49 devstack cinder-volume[87017]: DEBUG dbcounter [-] [87017] Writer thread running {{(pid=87017) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:02:49 devstack cinder-volume[87017]: INFO cinder.rpc [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 16:02:50 devstack cinder-volume[87017]: INFO cinder.rpc [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_db.sqlalchemy.engines [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87017) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:02:50 devstack cinder-volume[87017]: INFO cinder.volume.manager [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Determined volume DB was empty at startup. Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG cinder.volume.manager [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87017) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 16:02:50 devstack cinder-volume[87017]: WARNING stevedore.named [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:02:50 devstack cinder-volume[87017]: WARNING castellan.key_manager [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:02:50 devstack cinder-volume[87017]: WARNING cinder.keymgr.conf_key_mgr [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:02:50 devstack cinder-volume[87017]: INFO cinder.volume.manager [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_db.sqlalchemy.engines [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87017) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:02:50 devstack cinder-volume[87017]: INFO oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Starting 1 workers Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Started child 87314 {{(pid=87017) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Full set of CONF: {{(pid=87017) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] ******************************************************************************** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] Configuration options gathered from: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] ================================================================================ {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] allow_availability_zone_fallback = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] allow_compression_on_image_upload = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] allowed_direct_url_schemes = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] api_rate_limit = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] auth_strategy = keystone {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_availability_zone = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_host = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_stats_polling_interval = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backup_api_class = cinder.backup.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backup_name_template = backup-%s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backup_use_same_host = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backup_use_temp_snapshot = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] chap_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] chap_username = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87314]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cinder_internal_tenant_project_id = 61e90edf17aa4970befb4c7bac4ecbca {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cinder_internal_tenant_user_id = 986906818c184f1aa4a5959867195c4f {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cluster = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] compression_format = gzip {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] compute_api_class = cinder.compute.nova.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] config_dir = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] config_source = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] control_exchange = openstack {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] debug = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] default_availability_zone = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] default_group_type = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] default_volume_type = QuobyteHD {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] disk_geometry = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] driver_client_cert = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] driver_client_cert_key = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] driver_data_namespace = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] driver_ssl_cert_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] driver_ssl_cert_verify = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] driver_use_ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] enable_new_services = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] enable_unsupported_driver = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] enabled_backends = ['QuobyteHD'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] enforce_multipath_for_image_xfer = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] filter_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_api_insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_api_ssl_compression = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_ca_certificates_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_catalog_info = image:glance:publicURL {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_num_retries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance_request_timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] goodness_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] graceful_shutdown_timeout = 5 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] group_api_class = cinder.group.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] host = devstack {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_compress_on_upload = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_conversion_address_space_limit = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_conversion_cpu_limit = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_conversion_disable = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_introspection_address_space_limit = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_introspection_cpu_limit = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_upload_use_cinder_backend = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_upload_use_internal_tenant = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_volume_cache_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_volume_cache_max_count = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] image_volume_cache_max_size_gb = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] init_host_max_objects_retrieval = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] instance_format = [instance: %(uuid)s] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] iscsi_target_flags = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] iscsi_write_cache = on {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] iser_helper = tgtadm {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] iser_ip_address = 192.168.122.235 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] iser_port = 3260 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] log_color = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] log_config_append = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] log_dir = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] log_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] log_options = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] log_rotate_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] log_rotate_interval_type = days {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] log_rotation_type = none {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] max_age = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] max_logfile_count = 30 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] max_logfile_size_mb = 200 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] max_over_subscription_ratio = 20.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] message_reap_interval = 86400 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] message_ttl = 2592000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] migration_create_volume_timeout_secs = 300 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] monkey_patch = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] monkey_patch_modules = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] my_ip = 192.168.122.235 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] no_snapshot_gb_quota = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] num_iser_scan_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] num_shell_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] num_volume_device_scan_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] nvmeof_conn_info_version = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] nvmet_ns_id = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] nvmet_port_id = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] osapi_max_limit = 1000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] osapi_volume_ext_list = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] osapi_volume_listen = 0.0.0.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] osapi_volume_listen_port = 8776 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] osapi_volume_use_ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] osapi_volume_workers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] per_volume_size_limit = -1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] periodic_fuzzy_delay = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] periodic_interval = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] project_id_regex = [0-9a-f\-]+ {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] public_endpoint = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] publish_errors = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] quota_backup_gigabytes = 1000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] quota_backups = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] quota_gigabytes = 1000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] quota_groups = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] quota_snapshots = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] quota_volumes = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] rate_limit_burst = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] rate_limit_except_level = CRITICAL {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] rate_limit_interval = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] reinit_driver_count = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] replication_device = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] report_discard_supported = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] report_interval = 120 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] reservation_clean_interval = 86400 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] reservation_expire = 86400 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] reserved_image_namespaces = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] reserved_percentage = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] rpc_response_timeout = 120 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] run_external_periodic_tasks = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] scst_target_driver = iscsi {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] scst_target_iqn_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_down_time = 720 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] shell_completion = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] snapshot_name_template = snapshot-%s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87314) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] state_path = /opt/stack/data/cinder {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] storage_availability_zone = nova {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] storage_protocol = iSCSI {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] syslog_log_facility = LOG_USER {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] target_helper = lioadm {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] target_ip_address = 192.168.122.235 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] target_port = 3260 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] target_protocol = iscsi {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] target_secondary_ip_addresses = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] trace_flags = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] transfer_api_class = cinder.transfer.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] transport_url = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] until_refresh = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] use_chap_auth = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] use_default_quota_class = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] use_journal = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] use_json = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] use_multipath_for_image_xfer = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] use_stderr = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] use_syslog = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] verify_glance_signatures = enabled {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_api_class = cinder.volume.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_backend_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_clear = zero {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_clear_ionice = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_clear_size = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_copy_bps_limit = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_dd_blocksize = 1M {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_name_template = volume-%s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_service_inithost_offload = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volume_usage_audit_period = month {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] zoning_mode = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_concurrency.disable_process_locking = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.auth_section = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.auth_type = password {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.auth_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.cache = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.delay_auth_decision = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.http_connect_timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.include_service_catalog = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.interface = public {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcache_username = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.region_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.service_token_roles_required = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.service_type = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.token_cache_time = 300 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.backend = dogpile.cache.null {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.backend_argument = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.backend_expiration_time = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.config_prefix = cache.oslo {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.debug_cache_backend = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.enable_retry_client = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.enable_socket_keepalive = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.expiration_time = 600 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.hashclient_retry_attempts = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.memcache_dead_retry = 300 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.memcache_pool_maxsize = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.memcache_sasl_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.proxies = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.redis_db = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.redis_sentinel_service_name = mymaster {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.redis_server = localhost:6379 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.retry_attempts = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.retry_delay = 0.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.socket_keepalive_count = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.socket_keepalive_idle = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.socket_keepalive_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.socket_timeout = 1.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.tls_allowed_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.tls_cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.tls_certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.tls_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.tls_keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cache.username = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] coordination.backend_url = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.asyncio_connection = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.asyncio_slave_connection = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.backend = sqlalchemy {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.connection = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.connection_debug = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.connection_parameters = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.connection_recycle_time = 3600 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.connection_trace = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.db_inc_retry_interval = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.db_max_retries = 20 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.db_max_retry_interval = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.db_retry_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.max_overflow = 50 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.max_pool_size = 5 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.max_retries = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.mysql_wsrep_sync_wait = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.pool_timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.retry_interval = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.slave_connection = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.sqlite_synchronous = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.synchronous_reader = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] database.use_db_reconnect = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_tracing.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.connection_string = messaging:// {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.es_doc_type = notification {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.es_scroll_size = 10000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.es_scroll_time = 2m {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.filter_error_trace = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.hmac_keys = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.sentinel_service_name = mymaster {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.socket_timeout = 0.1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.trace_requests = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler.trace_sqlalchemy = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler_jaeger.process_tags = {} {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler_jaeger.service_name_prefix = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] profiler_otlp.service_name_prefix = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.enforce_new_defaults = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.policy_default_rule = default {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.policy_file = policy.yaml {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_policy.remote_timeout = 60.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] privsep_osbrick.group = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] privsep_osbrick.helper_command = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] privsep_osbrick.user = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cinder_sys_admin.group = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cinder_sys_admin.helper_command = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] cinder_sys_admin.user = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.auth_section = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87314) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.auth_type = password {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.quobyte [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.collect_timing = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.send_service_user_token = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.tls_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] service_user.tls_min_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.auth_section = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.auth_type = password {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.collect_timing = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.quobyte [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.region_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Running cmd (subprocess): mount.quobyte {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.tls_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] glance.tls_min_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.backend_availability_zone = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.chap_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.chap_username = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.disk_geometry = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.driver_client_cert = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.driver_client_cert_key = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.driver_data_namespace = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.driver_use_ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.enable_unsupported_driver = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.extra_capabilities = {} {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.filter_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.goodness_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.iscsi_target_flags = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.iscsi_write_cache = on {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.iser_helper = tgtadm {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.iser_port = 3260 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_host = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_login = admin {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_mount_options = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_private_key = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_share_path = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_ssh_port = 22 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.num_shell_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.nvmet_port_id = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.quobyte_client_cfg = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.quobyte_volume_url = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.replication_device = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.report_discard_supported = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.reserved_percentage = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.scst_target_driver = iscsi {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.scst_target_iqn_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.storage_protocol = iSCSI {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.target_helper = tgtadm {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.target_port = 3260 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.target_protocol = iscsi {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.trace_flags = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.unique_fqdn_network = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.use_chap_auth = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.volume_backend_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.volume_clear = zero {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.volume_clear_ionice = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.volume_clear_size = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_reports.file_event_handler = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_reports.log_dir = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.backend_availability_zone = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.backend_host = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.chap_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.chap_username = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.chiscsi_conf = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.disk_geometry = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.driver_client_cert = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.driver_client_cert_key = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.driver_data_namespace = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.driver_use_ssl = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.extra_capabilities = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.filter_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.goodness_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.iscsi_target_flags = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.iscsi_write_cache = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.iser_helper = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.iser_ip_address = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.iser_port = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.iser_target_prefix = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_host = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_login = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_mount_options = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_private_key = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_share_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_ssh_port = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.num_shell_tries = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nvmet_ns_id = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.nvmet_port_id = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.replication_device = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.report_discard_supported = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.reserved_percentage = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.scst_target_driver = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.storage_protocol = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.target_helper = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.target_ip_address = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.target_port = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.target_prefix = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.target_protocol = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack quobyte-client[87315]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 16:02:50 devstack quobyte-client[87315]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.trace_flags = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.unique_fqdn_network = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.use_chap_auth = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.volume_clear = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.volume_clear_ionice = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.volume_clear_size = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] QuobyteHD.volumes_dir = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.ssl_version = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_notifications.driver = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_notifications.retry = -1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] oslo_messaging_notifications.transport_url = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] key_manager.fixed_key = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.barbican_api_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.barbican_endpoint = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.barbican_endpoint_type = public {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.barbican_region_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.collect_timing = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.number_of_retries = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.retry_delay = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.send_service_user_token = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.tls_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.tls_min_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.verify_ssl = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican.verify_ssl_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.auth_section = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.auth_type = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.collect_timing = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.tls_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] barbican_service_user.tls_min_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.approle_role_id = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.approle_secret_id = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.auth_method = approle {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.auth_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.kv_mountpoint = secret {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.kv_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.kv_version = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.namespace = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.root_token_id = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.ssl_ca_crt_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.timeout = 60.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.token_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.token_role = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.use_ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:02:50 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-929881d1-99a0-477a-ab59-a520d41af2cf None None] ******************************************************************************** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 16:02:50 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:50 devstack cinder-volume[87314]: INFO cinder.volume.driver [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.driver [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3252029418945, 'free_capacity_gb': 1775.3252029418945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87314) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_db.sqlalchemy.engines [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87314) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writer thread running {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG cinder.db.api [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Building query based on filter {{(pid=87314) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87314) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1328}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:50 devstack cinder-volume[87314]: INFO cinder.keymgr.migration [None req-05baa497-d044-4dd4-9346-837009b7e6f6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 16:02:50 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:02:50 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:51 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.275s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:02:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Driver initialization completed successfully. Sep 25 16:02:51 devstack cinder-volume[87314]: INFO cinder.manager [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Initiating service 3 cleanup Sep 25 16:02:51 devstack cinder-volume[87314]: INFO cinder.manager [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Service 3 cleanup completed. Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG cinder.service [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Creating RPC server for service cinder-volume {{(pid=87314) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG cinder.service [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87314) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 16:02:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:51 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:02:51 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:51 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.269s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9005b5d5-ff44-40f9-868d-98d2706a5868 None None] Driver post RPC initialization completed successfully. Sep 25 16:02:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:02:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 6 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:02:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:03:00 devstack cinder-volume[87017]: DEBUG dbcounter [-] [87017] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87017) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:50 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:03:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Flow 'volume_create_manager' (f6ff676d-d965-4848-872b-19b860efe442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:03:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de066362-d1fc-48d9-99e4-9fd79fe4c923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de066362-d1fc-48d9-99e4-9fd79fe4c923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1750949904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a8d723-2a93-44d0-8cd7-6db8f06ff3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56606538642a41ab8d07a5bb3cef1a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:03:51Z,use_quota=True,user_id='53ff02adb77e4e9abcca2d738859004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a2c535-d875-43c4-bcbd-e2716a2330b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a2c535-d875-43c4-bcbd-e2716a2330b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b977035-2991-4976-a81f-e28a6952170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b977035-2991-4976-a81f-e28a6952170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a8d723-2a93-44d0-8cd7-6db8f06ff3e9', 'volume_name': 'volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a71bb4-9a55-42a1-a952-09fd0829f7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a71bb4-9a55-42a1-a952-09fd0829f7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48557f83-4188-4a2e-965d-bdd5c9de19d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:03:51 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Volume 22a8d723-2a93-44d0-8cd7-6db8f06ff3e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9', 'volume_size': 1} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1750949904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a8d723-2a93-44d0-8cd7-6db8f06ff3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56606538642a41ab8d07a5bb3cef1a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:03:51Z,use_quota=True,user_id='53ff02adb77e4e9abcca2d738859004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Creating volume 22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:03:51 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:03:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:51 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 1073741824 Sep 25 16:03:51 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:52 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 1073741824" returned: 0 in 1.082s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:52 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 Sep 25 16:03:52 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:52 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9" returned: 0 in 0.338s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:03:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48557f83-4188-4a2e-965d-bdd5c9de19d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:03:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6958a7c8-411c-4d95-8327-b20da65ed93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:03:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Volume volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 (22a8d723-2a93-44d0-8cd7-6db8f06ff3e9): created successfully Sep 25 16:03:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6958a7c8-411c-4d95-8327-b20da65ed93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:03:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Flow 'volume_create_manager' (f6ff676d-d965-4848-872b-19b860efe442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:03:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-48104d4f-2374-4765-a025-af6233544f97 tempest-TaggedAttachmentsTest-2124965053 None] Created volume successfully. Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:58 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:03:58 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:58 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 6 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:03:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:04:02 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:04:02 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Flow 'volume_create_manager' (b7685180-861b-4f2f-9e44-5e9cb5571563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7280e81-ea33-4321-92aa-476c8af225c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7280e81-ea33-4321-92aa-476c8af225c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-968727488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b079066-8e4e-4417-9dc4-a2805b4eb7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8255df74bc4fdaaa0e938a0cd147aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:04:28Z,use_quota=True,user_id='177d9f4675f54f1ab90734b18d7a128a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae3e8c5-9fd1-4900-81f6-c6fd89f4939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae3e8c5-9fd1-4900-81f6-c6fd89f4939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a607de63-25e7-4739-a79e-a7f557a8c04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a607de63-25e7-4739-a79e-a7f557a8c04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b079066-8e4e-4417-9dc4-a2805b4eb7c7', 'volume_name': 'volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f1c43f-f0cb-4e1e-a0ef-f5e09fa86b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f1c43f-f0cb-4e1e-a0ef-f5e09fa86b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2793cf5-2207-4fd0-a30f-448e9de3a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Volume 0b079066-8e4e-4417-9dc4-a2805b4eb7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7', 'volume_size': 1} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-968727488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b079066-8e4e-4417-9dc4-a2805b4eb7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8255df74bc4fdaaa0e938a0cd147aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:04:28Z,use_quota=True,user_id='177d9f4675f54f1ab90734b18d7a128a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Creating volume 0b079066-8e4e-4417-9dc4-a2805b4eb7c7 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:04:28 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:28 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 1073741824 Sep 25 16:04:28 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:29 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 1073741824" returned: 0 in 1.148s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:30 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 Sep 25 16:04:30 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:30 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7" returned: 0 in 0.725s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2793cf5-2207-4fd0-a30f-448e9de3a056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9896ed-1527-4254-a7d2-58e01de9e467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Volume volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 (0b079066-8e4e-4417-9dc4-a2805b4eb7c7): created successfully Sep 25 16:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9896ed-1527-4254-a7d2-58e01de9e467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Flow 'volume_create_manager' (b7685180-861b-4f2f-9e44-5e9cb5571563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:04:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a6ac3650-59ff-47be-99c4-a427a20a00be tempest-VolumesAdminNegativeTest-95847875 None] Created volume successfully. Sep 25 16:04:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Acquiring lock "cinder-0b079066-8e4e-4417-9dc4-a2805b4eb7c7-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:04:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Lock "cinder-0b079066-8e4e-4417-9dc4-a2805b4eb7c7-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:04:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Acquiring lock "cinder-quobyte-0b079066-8e4e-4417-9dc4-a2805b4eb7c7" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:04:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Lock "cinder-quobyte-0b079066-8e4e-4417-9dc4-a2805b4eb7c7" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:04:32 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp29wiu8za/privsep.sock'] Sep 25 16:04:32 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp29wiu8za/privsep.sock Sep 25 16:04:32 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:34 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 16:04:34 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:04:34 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 16:04:34 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 16:04:34 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:04:34 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 16:04:34 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:04:34 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 16:04:34 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 16:04:34 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:34 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Spawned new privsep daemon via rootwrap Sep 25 16:04:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Accepted privsep connection to /tmp/tmp29wiu8za/privsep.sock {{(pid=87314) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 16:04:34 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 16:04:34 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 16:04:34 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 16:04:34 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88357 Sep 25 16:04:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea0a5a8-a343-415c-ab36-933d05c08b9a]: (2,) {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:04:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[513937aa-0afa-47d8-8361-2b8e8fa96747]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:04:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:35 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 Sep 25 16:04:35 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:35 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7" returned: 0 in 0.593s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:35 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7 Sep 25 16:04:35 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:35 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0b079066-8e4e-4417-9dc4-a2805b4eb7c7" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Lock "cinder-quobyte-0b079066-8e4e-4417-9dc4-a2805b4eb7c7" released by "delete_volume" :: held 3.529s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:04:36 devstack cinder-volume[87314]: WARNING cinder.quota [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:04:36 devstack cinder-volume[87314]: WARNING cinder.quota [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:04:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Created reservations ['e3154d32-29e9-419f-bdae-98a0e4b5e0c2', '91c24cb1-dbb1-4c1b-8b57-ee56ffd9fff5', 'aa1a3a9c-2932-40d2-8b8f-103885a3c8d2', '647f5293-9854-4c3b-8743-e398ff27349d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:04:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:36 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:04:36 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:37 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.563s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:37 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:04:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Deleted volume successfully. Sep 25 16:04:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-faae1b83-c43f-4e87-a3dc-5a95b1d0fe1d tempest-VolumesAdminNegativeTest-95847875 None] Lock "cinder-0b079066-8e4e-4417-9dc4-a2805b4eb7c7-delete_volume" released by "delete_volume" :: held 4.925s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Flow 'volume_create_manager' (661af678-db51-4b67-8bae-fbffeef04c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcc24b1-fd2d-4cff-9cf5-a4f7609584cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcc24b1-fd2d-4cff-9cf5-a4f7609584cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1927688923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8df033-7261-4efb-a907-8c76cea2efd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3e8fab95c547439ecddab566d3b040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:04:46Z,use_quota=True,user_id='8ed2bf0be7164beda95e4fbb85c59e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5cff4b-c945-4eb2-847e-6d296623304e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5cff4b-c945-4eb2-847e-6d296623304e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b347df-b0fd-4383-80d8-9eb44e864127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b347df-b0fd-4383-80d8-9eb44e864127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8df033-7261-4efb-a907-8c76cea2efd6', 'volume_name': 'volume-5a8df033-7261-4efb-a907-8c76cea2efd6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699dfa69-24f6-456c-a0f5-c6c480833103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699dfa69-24f6-456c-a0f5-c6c480833103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412913f7-28ef-4d34-91cf-a1debe415dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Volume 5a8df033-7261-4efb-a907-8c76cea2efd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8df033-7261-4efb-a907-8c76cea2efd6', 'volume_size': 1} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1927688923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8df033-7261-4efb-a907-8c76cea2efd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3e8fab95c547439ecddab566d3b040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:04:46Z,use_quota=True,user_id='8ed2bf0be7164beda95e4fbb85c59e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Creating volume 5a8df033-7261-4efb-a907-8c76cea2efd6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:04:45 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:04:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:45 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6 1073741824 Sep 25 16:04:45 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:47 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6 1073741824" returned: 0 in 1.220s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:47 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6 Sep 25 16:04:47 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:47 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6" returned: 0 in 0.428s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:04:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412913f7-28ef-4d34-91cf-a1debe415dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8df033-7261-4efb-a907-8c76cea2efd6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ddf4fb-7888-43ad-966b-3295ed9203df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Volume volume-5a8df033-7261-4efb-a907-8c76cea2efd6 (5a8df033-7261-4efb-a907-8c76cea2efd6): created successfully Sep 25 16:04:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ddf4fb-7888-43ad-966b-3295ed9203df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Flow 'volume_create_manager' (661af678-db51-4b67-8bae-fbffeef04c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:04:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-522ada3d-3d86-41e8-8aae-d07bbb1870b0 tempest-AttachVolumeShelveTestJSON-614851742 None] Created volume successfully. Sep 25 16:04:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:04:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:04:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:04:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:58 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:04:58 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:58 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:08 devstack cinder-volume[87314]: WARNING py.warnings [req-dcebe53e-7422-404d-8e0c-37fc769f85d2 req-6d90ca24-c057-4167-a6fc-36f28888d01b tempest-AttachVolumeShelveTestJSON-614851742 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 25 16:05:08 devstack cinder-volume[87314]: .first() Sep 25 16:05:08 devstack cinder-volume[87314]: Sep 25 16:05:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-dcebe53e-7422-404d-8e0c-37fc769f85d2 req-6d90ca24-c057-4167-a6fc-36f28888d01b tempest-AttachVolumeShelveTestJSON-614851742 None] No connector for attachment dc2e1e41-9423-4c2f-b026-f761c0ec5759; skipping storage backend terminate_connection call. {{(pid=87314) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 16:05:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-dcebe53e-7422-404d-8e0c-37fc769f85d2 req-6d90ca24-c057-4167-a6fc-36f28888d01b tempest-AttachVolumeShelveTestJSON-614851742 None] Deleting attachment dc2e1e41-9423-4c2f-b026-f761c0ec5759. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:05:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e2fc9f8c-d0e7-483e-a981-9848b1c86bd0 req-88be8727-289c-4be3-ab61-57536526cba4 tempest-TaggedAttachmentsTest-2124965053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e2fc9f8c-d0e7-483e-a981-9848b1c86bd0 req-88be8727-289c-4be3-ab61-57536526cba4 tempest-TaggedAttachmentsTest-2124965053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e2fc9f8c-d0e7-483e-a981-9848b1c86bd0 req-88be8727-289c-4be3-ab61-57536526cba4 tempest-TaggedAttachmentsTest-2124965053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-e2fc9f8c-d0e7-483e-a981-9848b1c86bd0 req-88be8727-289c-4be3-ab61-57536526cba4 tempest-TaggedAttachmentsTest-2124965053 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9b478ed-c215-4d1c-8df1-5b4486caf1c6', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:05:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-e2fc9f8c-d0e7-483e-a981-9848b1c86bd0 req-88be8727-289c-4be3-ab61-57536526cba4 tempest-TaggedAttachmentsTest-2124965053 None] attachment_update completed successfully. Sep 25 16:05:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-ede2211d-1047-4168-9e63-95e78a331ab3 req-4f1ac7ad-c159-434c-ae6e-69a8f537b7b8 tempest-TaggedAttachmentsTest-2124965053 None] Terminate volume connection completed successfully. Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-ede2211d-1047-4168-9e63-95e78a331ab3 req-4f1ac7ad-c159-434c-ae6e-69a8f537b7b8 tempest-TaggedAttachmentsTest-2124965053 None] Deleting attachment e9b478ed-c215-4d1c-8df1-5b4486caf1c6. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Flow 'volume_create_manager' (b467a2f6-1713-4db7-9151-9193e82e8113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5739f3f4-73b2-4da2-84cf-2d9819978edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5739f3f4-73b2-4da2-84cf-2d9819978edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-562893307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f54c6de-0d3b-4275-9e01-da5420744f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a173f9aa4b4441dd8eec6755d9eeaea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:20Z,use_quota=True,user_id='e07ab28465144ae890ac24ca8937c7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baeaa06-5e2d-4f75-81b7-d75cbea323fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baeaa06-5e2d-4f75-81b7-d75cbea323fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7047c305-2366-444e-be48-b7e0f3c979da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7047c305-2366-444e-be48-b7e0f3c979da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f54c6de-0d3b-4275-9e01-da5420744f78', 'volume_name': 'volume-0f54c6de-0d3b-4275-9e01-da5420744f78', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a3021e-36d8-496d-8ba4-69cc352cb7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a3021e-36d8-496d-8ba4-69cc352cb7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b5dfc1-fad6-4bd2-aea8-a1f62c6bab60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Volume 0f54c6de-0d3b-4275-9e01-da5420744f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f54c6de-0d3b-4275-9e01-da5420744f78', 'volume_size': 1} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-562893307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f54c6de-0d3b-4275-9e01-da5420744f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a173f9aa4b4441dd8eec6755d9eeaea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:20Z,use_quota=True,user_id='e07ab28465144ae890ac24ca8937c7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Creating volume 0f54c6de-0d3b-4275-9e01-da5420744f78 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:05:19 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:05:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:19 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78 1073741824 Sep 25 16:05:19 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:21 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78 1073741824" returned: 0 in 1.531s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:21 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78 Sep 25 16:05:21 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:22 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78" returned: 0 in 0.799s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:05:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b5dfc1-fad6-4bd2-aea8-a1f62c6bab60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f54c6de-0d3b-4275-9e01-da5420744f78', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293d2957-fbe0-4d83-aa32-a5ca6ee0f126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Volume volume-0f54c6de-0d3b-4275-9e01-da5420744f78 (0f54c6de-0d3b-4275-9e01-da5420744f78): created successfully Sep 25 16:05:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293d2957-fbe0-4d83-aa32-a5ca6ee0f126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Flow 'volume_create_manager' (b467a2f6-1713-4db7-9151-9193e82e8113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5e1bfc16-8a75-47a7-970a-fe1c8159e560 tempest-DeleteServersTestJSON-1311039747 None] Created volume successfully. Sep 25 16:05:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ad96a77-adb4-4c9b-b9f0-98fb75b1d131 tempest-BackendsCapabilitiesAdminTestsJSON-129211665 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3252029418945, 'free_capacity_gb': 1775.3252029418945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87314) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 16:05:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b7fbe47-4c89-442b-8d2f-ef395aecf535 tempest-BackendsCapabilitiesAdminTestsJSON-129211665 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3252029418945, 'free_capacity_gb': 1775.3252029418945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87314) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 16:05:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-a332cee8-894d-428b-adae-f6be9608ee71 req-4e9d1b34-4b1b-4743-8819-c31a3640cf31 tempest-DeleteServersTestJSON-1311039747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-a332cee8-894d-428b-adae-f6be9608ee71 req-4e9d1b34-4b1b-4743-8819-c31a3640cf31 tempest-DeleteServersTestJSON-1311039747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-a332cee8-894d-428b-adae-f6be9608ee71 req-4e9d1b34-4b1b-4743-8819-c31a3640cf31 tempest-DeleteServersTestJSON-1311039747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-a332cee8-894d-428b-adae-f6be9608ee71 req-4e9d1b34-4b1b-4743-8819-c31a3640cf31 tempest-DeleteServersTestJSON-1311039747 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-0f54c6de-0d3b-4275-9e01-da5420744f78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31fa403f-2ab9-45cc-ac1d-c4195ad32475', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:05:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-a332cee8-894d-428b-adae-f6be9608ee71 req-4e9d1b34-4b1b-4743-8819-c31a3640cf31 tempest-DeleteServersTestJSON-1311039747 None] attachment_update completed successfully. Sep 25 16:05:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-0f45c60b-3d09-4edc-a294-3ee7b0f41686 req-83350410-b21d-49e8-bc12-d69ba8e6cfa5 tempest-DeleteServersTestJSON-1311039747 None] Terminate volume connection completed successfully. Sep 25 16:05:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-0f45c60b-3d09-4edc-a294-3ee7b0f41686 req-83350410-b21d-49e8-bc12-d69ba8e6cfa5 tempest-DeleteServersTestJSON-1311039747 None] Deleting attachment 31fa403f-2ab9-45cc-ac1d-c4195ad32475. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Acquiring lock "cinder-0f54c6de-0d3b-4275-9e01-da5420744f78-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Lock "cinder-0f54c6de-0d3b-4275-9e01-da5420744f78-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Acquiring lock "cinder-quobyte-0f54c6de-0d3b-4275-9e01-da5420744f78" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Lock "cinder-quobyte-0f54c6de-0d3b-4275-9e01-da5420744f78" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fc96bf-0329-4456-9271-a357aea2562e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:37 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78 Sep 25 16:05:37 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Acquiring lock "cinder-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Lock "cinder-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Acquiring lock "cinder-quobyte-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Lock "cinder-quobyte-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc5483b-1a93-465c-bae3-6b3d61d4edf2]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:37 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78" returned: 0 in 0.755s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:38 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78 Sep 25 16:05:38 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:38 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 Sep 25 16:05:38 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:38 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f54c6de-0d3b-4275-9e01-da5420744f78" returned: 0 in 0.457s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Lock "cinder-quobyte-0f54c6de-0d3b-4275-9e01-da5420744f78" released by "delete_volume" :: held 1.301s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Created reservations ['20d1cb96-aa78-47e1-a0c9-3189c871e8d8', '7ca8ae3e-403f-4dc9-9701-dc97a8953870', 'b5234573-54de-4cd5-81e3-ca2f997c3c0d', '55089a24-28bd-4071-86e5-6f949de0ccc1'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:05:38 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9" returned: 0 in 0.603s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:38 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9 Sep 25 16:05:38 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:38 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:05:38 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:38 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9" returned: 0 in 0.406s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Lock "cinder-quobyte-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9" released by "delete_volume" :: held 1.080s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Created reservations ['63100c8b-d14f-41a5-813f-56eba9dd065d', '142cb627-5de8-433a-8133-7e06752109ec', 'ba3771e0-7f0a-4aaf-b9f9-cfae8843949c', '5b614dd6-37f7-4ae9-800e-4a56d9c85fb3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:05:39 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.386s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Deleted volume successfully. Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fff473db-6c53-4dcd-b3b1-072bd4527653 tempest-DeleteServersTestJSON-1311039747 None] Lock "cinder-0f54c6de-0d3b-4275-9e01-da5420744f78-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:39 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:05:39 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-14a588f4-c63a-4638-8086-b4e40c242f7a tempest-GroupSnapshotsTest-438921265 None] Group tempest-GroupSnapshotsTest-Group-9400129: creating Sep 25 16:05:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-14a588f4-c63a-4638-8086-b4e40c242f7a tempest-GroupSnapshotsTest-438921265 None] Group tempest-GroupSnapshotsTest-Group-9400129: created successfully Sep 25 16:05:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-14a588f4-c63a-4638-8086-b4e40c242f7a tempest-GroupSnapshotsTest-438921265 None] Create group completed successfully. Sep 25 16:05:39 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.504s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Deleted volume successfully. Sep 25 16:05:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b1fe7142-9168-4300-88d2-0b823c45d99b tempest-TaggedAttachmentsTest-2124965053 None] Lock "cinder-22a8d723-2a93-44d0-8cd7-6db8f06ff3e9-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:41 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:05:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Flow 'volume_create_manager' (adfe56e5-72e5-4cef-a58c-235793cae35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a08559-5e14-4359-b9da-978d8b342771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a08559-5e14-4359-b9da-978d8b342771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803871760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=127aadba-7127-468d-a79a-6dbe8c013951,host='devstack@QuobyteHD#QuobyteHD',id=f1d26d46-6d49-4ae5-a5e0-9bc809649f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa554799b93f4d628305f273168c4a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:42Z,use_quota=True,user_id='29413405d9e64e5c9c6a0949dca021e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70b97a0e-5e2f-449d-bc96-e4b6cae6be4e),volume_type_id=70b97a0e-5e2f-449d-bc96-e4b6cae6be4e)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bddae62-56c5-4311-aab0-c5994dc08d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bddae62-56c5-4311-aab0-c5994dc08d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b694cd6d-e549-43e7-b3d7-03661214ac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b694cd6d-e549-43e7-b3d7-03661214ac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d26d46-6d49-4ae5-a5e0-9bc809649f53', 'volume_name': 'volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202d0e8d-88ae-48f0-82c4-0c14a7194e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202d0e8d-88ae-48f0-82c4-0c14a7194e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e2d6c8-4021-457e-b0f6-19f9a57eda1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Volume f1d26d46-6d49-4ae5-a5e0-9bc809649f53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53', 'volume_size': 1} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=127aadba-7127-468d-a79a-6dbe8c013951,created_at=2026-09-25T14:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803871760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=127aadba-7127-468d-a79a-6dbe8c013951,host='devstack@QuobyteHD#QuobyteHD',id=f1d26d46-6d49-4ae5-a5e0-9bc809649f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa554799b93f4d628305f273168c4a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:42Z,use_quota=True,user_id='29413405d9e64e5c9c6a0949dca021e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70b97a0e-5e2f-449d-bc96-e4b6cae6be4e),volume_type_id=70b97a0e-5e2f-449d-bc96-e4b6cae6be4e)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Creating volume f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:05:42 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:42 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 1073741824 Sep 25 16:05:42 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:42 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 1073741824" returned: 0 in 0.741s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:42 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 Sep 25 16:05:42 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:43 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" returned: 0 in 0.337s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:05:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e2d6c8-4021-457e-b0f6-19f9a57eda1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f10d58-dbd7-4ec1-9fb2-9676897e5696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:43 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Volume volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 (f1d26d46-6d49-4ae5-a5e0-9bc809649f53): created successfully Sep 25 16:05:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f10d58-dbd7-4ec1-9fb2-9676897e5696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Flow 'volume_create_manager' (adfe56e5-72e5-4cef-a58c-235793cae35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bc646768-20fe-4e87-94a4-218f57fd8431 tempest-GroupSnapshotsTest-438921265 None] Created volume successfully. Sep 25 16:05:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] GroupSnapshot db4efc9d-867b-473e-bf0a-551a6370b609: creating. Sep 25 16:05:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Group snapshot db4efc9d-867b-473e-bf0a-551a6370b609: creating. {{(pid=87314) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:05:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Creating offline snapshot fd10ab4b-afb1-452b-8f8e-6272932d52dd of volume f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:05:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fc5726-ac32-4271-8bd2-f9d2fc75dd96]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:45 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 Sep 25 16:05:45 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:46 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" returned: 0 in 0.722s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:46 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd 1G Sep 25 16:05:46 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:47 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd 1G" returned: 0 in 0.676s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:47 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd Sep 25 16:05:47 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:47 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd" returned: 0 in 0.424s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:47 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:05:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:47 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd Sep 25 16:05:47 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:47 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:47 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.info Sep 25 16:05:47 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:48 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.info" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:48 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:05:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:48 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.info Sep 25 16:05:48 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:48 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.info" returned: 0 in 0.333s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.030s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e85a776f-c32b-4ae2-a69e-b9a0604e3b08 tempest-GroupSnapshotsTest-438921265 None] group_snapshot db4efc9d-867b-473e-bf0a-551a6370b609: created successfully Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-fd10ab4b-afb1-452b-8f8e-6272932d52dd-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-fd10ab4b-afb1-452b-8f8e-6272932d52dd-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Creating volume 0a2843ea-6940-40fa-8fde-a4e89e4ebe3f from snapshot fd10ab4b-afb1-452b-8f8e-6272932d52dd {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] snapshot: fd10ab4b-afb1-452b-8f8e-6272932d52dd, volume: 0a2843ea-6940-40fa-8fde-a4e89e4ebe3f, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d60e270-ed3b-448f-b7de-50846bfdf0b5]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:50 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd Sep 25 16:05:50 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:50 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd" returned: 0 in 0.673s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:05:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8a400a-75b9-40e9-84e5-4fdf87704c3a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:50 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 Sep 25 16:05:50 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:51 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" returned: 0 in 0.464s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:05:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:05:51 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:05:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:51 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f Sep 25 16:05:51 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:05:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:58 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:05:58 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:59 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.717s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:05:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 8 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:05:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:05:59 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=40,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:59 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=40,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:06:00 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" returned: 0 in 9.179s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:00 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53, size 1024.00 MB, duration 9.18 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:06:00 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Converted 1024.00 MB image at 111.54 MB/s Sep 25 16:06:00 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:06:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:00 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f Sep 25 16:06:00 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:00 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" returned: 0 in 0.392s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" released by "_copy_volume_from_snapshot" :: held 10.851s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-fd10ab4b-afb1-452b-8f8e-6272932d52dd-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" released by "_create_volume_from_snapshot" :: held 10.969s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.991s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-062064de-0b0d-4b2d-b708-1af871a098b3 tempest-GroupSnapshotsTest-438921265 None] Create group from source-snapshot-db4efc9d-867b-473e-bf0a-551a6370b609 completed successfully. Sep 25 16:06:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" acquired by "delete_volume" :: waited 0.045s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee85f5a-c563-4f82-8068-f2a9291c5f3f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:02 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f Sep 25 16:06:02 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:03 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" returned: 0 in 0.687s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:03 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f Sep 25 16:06:03 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:03 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-0a2843ea-6940-40fa-8fde-a4e89e4ebe3f" released by "delete_volume" :: held 1.186s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:03 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Created reservations ['f7065e73-2568-478e-a44e-c927a1b568f8'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:03 devstack cinder-volume[87314]: WARNING cinder.quota [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-58794656 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-58794656, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:06:04 devstack cinder-volume[87314]: WARNING cinder.quota [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-58794656 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-58794656, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:06:04 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Created reservations ['97279bae-f3b6-4153-be09-017c1374228a', '1eb90f75-6a62-462c-bdea-db1cbb0e7eed', 'f3fc0e15-d57a-4d92-ba5b-522fd3a58539', '4f9406b0-7359-493e-a9e0-0ae4f5ec964d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:04 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:06:04 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:04 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:04 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-354a3bc6-8243-42db-91c9-7e63939c249d tempest-GroupSnapshotsTest-438921265 None] Delete group completed successfully. Sep 25 16:06:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] group_snapshot db4efc9d-867b-473e-bf0a-551a6370b609: deleting Sep 25 16:06:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] group_snapshot db4efc9d-867b-473e-bf0a-551a6370b609: deleting {{(pid=87314) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:06:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-fd10ab4b-afb1-452b-8f8e-6272932d52dd" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-fd10ab4b-afb1-452b-8f8e-6272932d52dd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Deleting offline snapshot fd10ab4b-afb1-452b-8f8e-6272932d52dd of volume f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:06:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] snapshot_file for this snap is: volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:06:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9b5f99-3629-461b-b587-271a8b3d0c2b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:05 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd Sep 25 16:06:05 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:06 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd" returned: 0 in 0.490s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:06:06 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[445d61da-5ac0-4d61-b32e-50de473e9487]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:06 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 Sep 25 16:06:06 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:06 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" returned: 0 in 0.735s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:06 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd Sep 25 16:06:06 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:07 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd" returned: 0 in 0.485s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:07 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd Sep 25 16:06:07 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:07 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53.fd10ab4b-afb1-452b-8f8e-6272932d52dd" returned: 0 in 0.410s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-fd10ab4b-afb1-452b-8f8e-6272932d52dd" released by "_delete_snapshot" :: held 2.307s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" released by "delete_snapshot" :: held 2.333s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:07 devstack cinder-volume[87314]: WARNING cinder.quota [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-58794656 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-58794656, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:06:07 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] Created reservations ['97d62d4f-eaf2-44b9-a115-04fd99a761bd', '42cbebde-1693-46a0-a9f2-03b0b62b4bec', '5e9f3688-d681-4dc4-8d02-9a88e61277da', 'aca35657-c10a-4332-95f0-993fa5e5d456'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d5efb405-ec78-4700-b809-31fe33660c3d tempest-GroupSnapshotsTest-438921265 None] group_snapshot db4efc9d-867b-473e-bf0a-551a6370b609: deleted successfully Sep 25 16:06:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" acquired by "delete_volume" :: waited 0.042s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[93266f71-2dfa-428f-8cce-096fe9a9892c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:09 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 Sep 25 16:06:09 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:09 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" returned: 0 in 0.477s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:09 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53 Sep 25 16:06:09 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:10 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-f1d26d46-6d49-4ae5-a5e0-9bc809649f53" released by "delete_volume" :: held 0.991s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Created reservations ['76a3ec33-db15-41be-b5e0-80b0ca111a35'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:10 devstack cinder-volume[87314]: WARNING cinder.db.api [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-58794656'] Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Created reservations ['7d8345e2-cb4f-424c-822f-1f3e374e5c04', 'e93f8f5b-61fa-4f59-baa0-d4cc73eaec4c', 'c78f61de-b303-42ca-9028-3b11af4ca068', '3d1a5b2f-1ad8-4eff-9247-b71da3fca219'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:10 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:06:10 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:10 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:10 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2a6408f4-472c-4d69-9353-9724d059958e tempest-GroupSnapshotsTest-438921265 None] Delete group completed successfully. Sep 25 16:06:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Acquiring lock "cinder-5a8df033-7261-4efb-a907-8c76cea2efd6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "cinder-5a8df033-7261-4efb-a907-8c76cea2efd6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Acquiring lock "cinder-quobyte-5a8df033-7261-4efb-a907-8c76cea2efd6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "cinder-quobyte-5a8df033-7261-4efb-a907-8c76cea2efd6" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3451f2ec-adf4-4b22-9506-f23aadaf9adc]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:11 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6 Sep 25 16:06:11 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:12 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6" returned: 0 in 0.567s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:12 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6 Sep 25 16:06:12 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:12 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5a8df033-7261-4efb-a907-8c76cea2efd6" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "cinder-quobyte-5a8df033-7261-4efb-a907-8c76cea2efd6" released by "delete_volume" :: held 1.098s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-07900baf-7c59-43fa-8b29-2204dfef64e8 tempest-GroupSnapshotsTest-438921265 None] Group tempest-GroupSnapshotsTest-Group-1461494047: creating Sep 25 16:06:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-07900baf-7c59-43fa-8b29-2204dfef64e8 tempest-GroupSnapshotsTest-438921265 None] Group tempest-GroupSnapshotsTest-Group-1461494047: created successfully Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Created reservations ['84716314-5ad9-473e-81fd-263abe2688b0', 'b7ee4d19-dfa1-4522-820f-404c4db01256', 'd18f8c58-9f8d-4370-aa94-0004d0180759', '5d3470d9-db13-4f8d-8bbb-393eaec9b399'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-07900baf-7c59-43fa-8b29-2204dfef64e8 tempest-GroupSnapshotsTest-438921265 None] Create group completed successfully. Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:13 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:06:13 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:13 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:13 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Deleted volume successfully. Sep 25 16:06:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bbf3c6d6-9836-4d16-93ed-2ad1752098e7 tempest-AttachVolumeShelveTestJSON-614851742 None] Lock "cinder-5a8df033-7261-4efb-a907-8c76cea2efd6-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:14 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Flow 'volume_create_manager' (4753066b-23c9-4360-8ab5-58a75cf89ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2399f3-86a0-4545-8910-ebf5d9e5cb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2399f3-86a0-4545-8910-ebf5d9e5cb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137953844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=602612a2-478d-451a-a5f9-71c2b1872fa2,host='devstack@QuobyteHD#QuobyteHD',id=072471ac-af5e-40ad-ad06-6480414f3fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa554799b93f4d628305f273168c4a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:15Z,use_quota=True,user_id='29413405d9e64e5c9c6a0949dca021e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47eace41-15eb-4975-8a1c-61be96859b40),volume_type_id=47eace41-15eb-4975-8a1c-61be96859b40)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1824867-d839-4c5d-ad51-ae8b6c6e73e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1824867-d839-4c5d-ad51-ae8b6c6e73e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d326c5ee-8dc5-4717-97a8-a011e56501dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d326c5ee-8dc5-4717-97a8-a011e56501dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072471ac-af5e-40ad-ad06-6480414f3fcd', 'volume_name': 'volume-072471ac-af5e-40ad-ad06-6480414f3fcd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a854bb31-42c5-41f0-abcd-b0cfb5310d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a854bb31-42c5-41f0-abcd-b0cfb5310d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b79ed0-afdb-4a19-b1d5-bcf790239f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Volume 072471ac-af5e-40ad-ad06-6480414f3fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072471ac-af5e-40ad-ad06-6480414f3fcd', 'volume_size': 1} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=602612a2-478d-451a-a5f9-71c2b1872fa2,created_at=2026-09-25T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137953844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=602612a2-478d-451a-a5f9-71c2b1872fa2,host='devstack@QuobyteHD#QuobyteHD',id=072471ac-af5e-40ad-ad06-6480414f3fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa554799b93f4d628305f273168c4a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:15Z,use_quota=True,user_id='29413405d9e64e5c9c6a0949dca021e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47eace41-15eb-4975-8a1c-61be96859b40),volume_type_id=47eace41-15eb-4975-8a1c-61be96859b40)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Creating volume 072471ac-af5e-40ad-ad06-6480414f3fcd {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:15 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:06:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:15 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd 1073741824 Sep 25 16:06:15 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:16 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd 1073741824" returned: 0 in 0.950s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:16 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd Sep 25 16:06:16 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:16 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b79ed0-afdb-4a19-b1d5-bcf790239f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072471ac-af5e-40ad-ad06-6480414f3fcd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10316fe2-9b75-4f1a-8899-7441db216893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Volume volume-072471ac-af5e-40ad-ad06-6480414f3fcd (072471ac-af5e-40ad-ad06-6480414f3fcd): created successfully Sep 25 16:06:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10316fe2-9b75-4f1a-8899-7441db216893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Flow 'volume_create_manager' (4753066b-23c9-4360-8ab5-58a75cf89ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dd510123-e15c-46aa-b7cf-1bb334d4e3b8 tempest-GroupSnapshotsTest-438921265 None] Created volume successfully. Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Flow 'volume_create_manager' (22d5ec47-e3f5-4f8e-a5a9-35043c355478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e07b4a-e32d-4ca0-83a6-f3598afca086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e07b4a-e32d-4ca0-83a6-f3598afca086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1926929719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=602612a2-478d-451a-a5f9-71c2b1872fa2,host='devstack@QuobyteHD#QuobyteHD',id=e15fc8f8-848d-4f63-8a72-d01fdec23374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa554799b93f4d628305f273168c4a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:18Z,use_quota=True,user_id='29413405d9e64e5c9c6a0949dca021e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47eace41-15eb-4975-8a1c-61be96859b40),volume_type_id=47eace41-15eb-4975-8a1c-61be96859b40)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4317a4-a96e-446d-91e1-6538ee5e5afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4317a4-a96e-446d-91e1-6538ee5e5afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb761cbe-f371-4d6f-80e7-db919b7f3f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb761cbe-f371-4d6f-80e7-db919b7f3f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e15fc8f8-848d-4f63-8a72-d01fdec23374', 'volume_name': 'volume-e15fc8f8-848d-4f63-8a72-d01fdec23374', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7066cdd7-ace8-49bc-97cc-302bfc410795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7066cdd7-ace8-49bc-97cc-302bfc410795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034c7a6f-802d-421f-95b6-6aa04cb77d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:18 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Volume e15fc8f8-848d-4f63-8a72-d01fdec23374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e15fc8f8-848d-4f63-8a72-d01fdec23374', 'volume_size': 1} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=602612a2-478d-451a-a5f9-71c2b1872fa2,created_at=2026-09-25T14:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1926929719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=602612a2-478d-451a-a5f9-71c2b1872fa2,host='devstack@QuobyteHD#QuobyteHD',id=e15fc8f8-848d-4f63-8a72-d01fdec23374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa554799b93f4d628305f273168c4a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:18Z,use_quota=True,user_id='29413405d9e64e5c9c6a0949dca021e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47eace41-15eb-4975-8a1c-61be96859b40),volume_type_id=47eace41-15eb-4975-8a1c-61be96859b40)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Creating volume e15fc8f8-848d-4f63-8a72-d01fdec23374 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:18 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:18 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 1073741824 Sep 25 16:06:18 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:18 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 1073741824" returned: 0 in 0.520s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:18 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 Sep 25 16:06:18 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:19 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034c7a6f-802d-421f-95b6-6aa04cb77d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e15fc8f8-848d-4f63-8a72-d01fdec23374', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d31ddb-3d8c-4b8a-b96e-088f6744e5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Volume volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 (e15fc8f8-848d-4f63-8a72-d01fdec23374): created successfully Sep 25 16:06:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d31ddb-3d8c-4b8a-b96e-088f6744e5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Flow 'volume_create_manager' (22d5ec47-e3f5-4f8e-a5a9-35043c355478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-129567fa-5017-43f3-8b30-33ff07535138 tempest-GroupSnapshotsTest-438921265 None] Created volume successfully. Sep 25 16:06:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c688c97d-25ed-4a7b-8b95-4992b256a6ba tempest-GroupSnapshotsTest-438921265 None] Update group completed successfully. Sep 25 16:06:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-09a65251-a8b4-4302-b200-56db74bb7cb2 tempest-GroupSnapshotsTest-438921265 None] Update group completed successfully. Sep 25 16:06:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1b850c7f-f0ef-4fbe-9513-b2bda53fbc47 tempest-GroupSnapshotsTest-438921265 None] Update group completed successfully. Sep 25 16:06:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5f232a76-935b-41fe-9702-42b1ac3103e5 tempest-GroupSnapshotsTest-438921265 None] Update group completed successfully. Sep 25 16:06:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] GroupSnapshot 59e5f073-45ca-4f85-af4d-6c3baf78d324: creating. Sep 25 16:06:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Group snapshot 59e5f073-45ca-4f85-af4d-6c3baf78d324: creating. {{(pid=87314) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:06:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Creating offline snapshot 2067b5f2-bb6f-4e77-8755-f2fe87071530 of volume 072471ac-af5e-40ad-ad06-6480414f3fcd {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:06:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4f78af-a498-4fdc-bafd-d29bb9894034]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:26 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd Sep 25 16:06:26 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:27 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd" returned: 0 in 0.916s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:27 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 1G Sep 25 16:06:27 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:28 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 1G" returned: 0 in 1.158s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-072471ac-af5e-40ad-ad06-6480414f3fcd -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:28 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-072471ac-af5e-40ad-ad06-6480414f3fcd -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 Sep 25 16:06:28 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:29 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-072471ac-af5e-40ad-ad06-6480414f3fcd -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530" returned: 0 in 0.737s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:06:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:29 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 Sep 25 16:06:29 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:29 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530" returned: 0 in 0.540s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:29 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.info Sep 25 16:06:29 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:30 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.info" returned: 0 in 0.719s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:30 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:30 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.info Sep 25 16:06:30 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Flow 'volume_create_manager' (20e0fd18-a2c1-4168-bdc7-2225da0af973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d31b5ea-2d60-4963-919f-ec4d2c6b4940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d31b5ea-2d60-4963-919f-ec4d2c6b4940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-32965956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a73a03-f122-4d51-9cb7-6a8974263b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3debc6614684ac987696d4e6253b015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:31Z,use_quota=True,user_id='fc4bcf1508714b19be07fed73aaf46a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1406c609-f553-4be8-aae3-eede23844519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1406c609-f553-4be8-aae3-eede23844519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351e6a63-f58e-4a0e-9ca4-14cd0b0d5e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351e6a63-f58e-4a0e-9ca4-14cd0b0d5e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a73a03-f122-4d51-9cb7-6a8974263b76', 'volume_name': 'volume-e9a73a03-f122-4d51-9cb7-6a8974263b76', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28a9556-c425-40a7-9cad-793f49cb5111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28a9556-c425-40a7-9cad-793f49cb5111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df09648-e26d-4251-9491-8b55c2415319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Volume e9a73a03-f122-4d51-9cb7-6a8974263b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a73a03-f122-4d51-9cb7-6a8974263b76', 'volume_size': 1} Sep 25 16:06:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:31 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.info" returned: 0 in 0.664s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.957s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Creating offline snapshot fed4d981-7c12-4aa8-9a06-c39f0fab272f of volume e15fc8f8-848d-4f63-8a72-d01fdec23374 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:06:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d0b488-184a-46d9-b32d-0e7e1dd4373a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:31 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 Sep 25 16:06:31 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:32 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374" returned: 0 in 0.835s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:32 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f 1G Sep 25 16:06:32 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:33 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f 1G" returned: 0 in 1.307s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:33 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f Sep 25 16:06:33 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:34 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f" returned: 0 in 0.769s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:34 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:06:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:34 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f Sep 25 16:06:34 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:34 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f" returned: 0 in 0.665s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:35 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.info Sep 25 16:06:35 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:35 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.info" returned: 0 in 0.658s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:35 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:06:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:35 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.info Sep 25 16:06:35 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:36 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.info" returned: 0 in 0.743s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.202s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.691s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-32965956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a73a03-f122-4d51-9cb7-6a8974263b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3debc6614684ac987696d4e6253b015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:31Z,use_quota=True,user_id='fc4bcf1508714b19be07fed73aaf46a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Creating volume e9a73a03-f122-4d51-9cb7-6a8974263b76 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:06:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:36 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 1073741824 Sep 25 16:06:36 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-619af4f9-0e46-4b81-97e6-9bb1a8f8dea7 tempest-GroupSnapshotsTest-438921265 None] group_snapshot 59e5f073-45ca-4f85-af4d-6c3baf78d324: created successfully Sep 25 16:06:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] group_snapshot 59e5f073-45ca-4f85-af4d-6c3baf78d324: deleting Sep 25 16:06:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] group_snapshot 59e5f073-45ca-4f85-af4d-6c3baf78d324: deleting {{(pid=87314) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:06:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-072471ac-af5e-40ad-ad06-6480414f3fcd" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-072471ac-af5e-40ad-ad06-6480414f3fcd" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-2067b5f2-bb6f-4e77-8755-f2fe87071530" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 1073741824" returned: 0 in 1.411s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:37 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-2067b5f2-bb6f-4e77-8755-f2fe87071530" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Deleting offline snapshot 2067b5f2-bb6f-4e77-8755-f2fe87071530 of volume 072471ac-af5e-40ad-ad06-6480414f3fcd {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:06:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] snapshot_file for this snap is: volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:06:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df7dd60-f588-49b9-af9f-a1c2cc715e8f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:38 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 Sep 25 16:06:38 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:38 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 Sep 25 16:06:38 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:39 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76" returned: 0 in 1.019s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] <== create_volume: return (2681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.687s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df09648-e26d-4251-9491-8b55c2415319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a73a03-f122-4d51-9cb7-6a8974263b76', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daaa54e4-0cc5-4ec5-a8cf-5bbdf91b1155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Volume volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 (e9a73a03-f122-4d51-9cb7-6a8974263b76): created successfully Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daaa54e4-0cc5-4ec5-a8cf-5bbdf91b1155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Flow 'volume_create_manager' (20e0fd18-a2c1-4168-bdc7-2225da0af973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-1e94e549-f4a5-432e-8416-e979b53dee2a req-316a1d33-8a67-47ff-a9e2-a43d11b76e74 tempest-VolumesSnapshotsTestJSON-320699860 None] Created volume successfully. Sep 25 16:06:39 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530" returned: 0 in 1.311s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-072471ac-af5e-40ad-ad06-6480414f3fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dde1d3-3354-41d1-bb33-70127f7b2f13]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:39 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd Sep 25 16:06:39 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:40 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd" returned: 0 in 0.806s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:40 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 Sep 25 16:06:40 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Creating offline snapshot b8bb3a2d-7260-4f02-9997-eaceed10e964 of volume e9a73a03-f122-4d51-9cb7-6a8974263b76 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:06:41 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac8fd70-a44a-4dfc-8592-5e41f89b4d82]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:42 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530" returned: 0 in 1.856s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:42 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530 Sep 25 16:06:42 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:42 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 Sep 25 16:06:42 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:43 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd.2067b5f2-bb6f-4e77-8755-f2fe87071530" returned: 0 in 0.970s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-2067b5f2-bb6f-4e77-8755-f2fe87071530" released by "_delete_snapshot" :: held 5.269s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-072471ac-af5e-40ad-ad06-6480414f3fcd" released by "delete_snapshot" :: held 5.386s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-e15fc8f8-848d-4f63-8a72-d01fdec23374" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-e15fc8f8-848d-4f63-8a72-d01fdec23374" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-fed4d981-7c12-4aa8-9a06-c39f0fab272f" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-fed4d981-7c12-4aa8-9a06-c39f0fab272f" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Deleting offline snapshot fed4d981-7c12-4aa8-9a06-c39f0fab272f of volume e15fc8f8-848d-4f63-8a72-d01fdec23374 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:06:43 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] snapshot_file for this snap is: volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76" returned: 0 in 1.692s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e4f48d-9ed2-4dfd-b2e6-c9fc35122a3a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:43 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 1G Sep 25 16:06:43 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:44 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f Sep 25 16:06:44 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:44 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f" returned: 0 in 0.782s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e15fc8f8-848d-4f63-8a72-d01fdec23374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:06:44 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[28baf4ee-1faa-40f8-8e29-68059442bbdb]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:44 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 Sep 25 16:06:44 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:44 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 1G" returned: 0 in 1.065s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:44 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 Sep 25 16:06:44 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:45 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374" returned: 0 in 0.657s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:45 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f Sep 25 16:06:45 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:45 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964" returned: 0 in 0.537s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:45 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 is being set with open permissions: ugo+rw Sep 25 16:06:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:45 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 Sep 25 16:06:45 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:45 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964" returned: 0 in 0.485s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:45 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.info Sep 25 16:06:45 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:46 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f" returned: 0 in 0.957s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:46 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f Sep 25 16:06:46 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:46 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.info" returned: 0 in 0.893s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:46 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.info is being set with open permissions: ugo+rw Sep 25 16:06:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:46 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.info Sep 25 16:06:46 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:46 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374.fed4d981-7c12-4aa8-9a06-c39f0fab272f" returned: 0 in 0.794s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-fed4d981-7c12-4aa8-9a06-c39f0fab272f" released by "_delete_snapshot" :: held 3.481s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-e15fc8f8-848d-4f63-8a72-d01fdec23374" released by "delete_snapshot" :: held 3.589s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:47 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.info" returned: 0 in 0.452s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.484s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-8186c712-8eb4-485f-9b64-9982ffaae28c req-d0a04e37-8316-4112-afb6-b44539fa610b tempest-VolumesSnapshotsTestJSON-320699860 None] Create snapshot completed successfully Sep 25 16:06:47 devstack cinder-volume[87314]: WARNING cinder.quota [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-643913415 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-643913415, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:06:47 devstack cinder-volume[87314]: WARNING cinder.quota [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-643913415 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-643913415, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:06:47 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Created reservations ['782da95a-a80a-4b65-b3c6-081247898780', '66558b8a-9593-4b1e-8163-5b9e6cd346ef', 'd8beb425-2bad-45d0-9c10-cddb3f57a561', '6046bce5-741e-4bcc-801f-a1ab14adc856'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:47 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] Created reservations ['f60f77bf-a066-4a06-8357-fee91b5b8c5d', '812147bb-c473-4125-947b-f32bca5b42c3', '04723789-d4f0-45ef-ba9b-2760e367a186', '2923a29d-a9a1-4855-9075-12bb2dc25ca3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9429e263-45c2-4acd-bfcc-f9b9935fd546 tempest-GroupSnapshotsTest-438921265 None] group_snapshot 59e5f073-45ca-4f85-af4d-6c3baf78d324: deleted successfully Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Acquiring lock "cinder-b8bb3a2d-7260-4f02-9997-eaceed10e964-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-b8bb3a2d-7260-4f02-9997-eaceed10e964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Acquiring lock "cinder-quobyte-e9a73a03-f122-4d51-9cb7-6a8974263b76" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-quobyte-e9a73a03-f122-4d51-9cb7-6a8974263b76" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Acquiring lock "cinder-quobyte-b8bb3a2d-7260-4f02-9997-eaceed10e964" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-quobyte-b8bb3a2d-7260-4f02-9997-eaceed10e964" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Deleting offline snapshot b8bb3a2d-7260-4f02-9997-eaceed10e964 of volume e9a73a03-f122-4d51-9cb7-6a8974263b76 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] snapshot_file for this snap is: volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5a0374-14c9-4adf-ac42-69a3e4de464c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:48 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 Sep 25 16:06:48 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:48 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964" returned: 0 in 0.629s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9a73a03-f122-4d51-9cb7-6a8974263b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:06:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0997dcf9-e3c8-4975-8c6c-9c36de6212ca]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:49 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 Sep 25 16:06:49 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:49 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76" returned: 0 in 0.997s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:50 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 Sep 25 16:06:50 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-072471ac-af5e-40ad-ad06-6480414f3fcd" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-072471ac-af5e-40ad-ad06-6480414f3fcd" acquired by "delete_volume" :: waited 0.055s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af80258-cfd9-4180-8f97-9d4bbb7e970f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:51 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd Sep 25 16:06:51 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:51 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964" returned: 0 in 1.576s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:51 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964 Sep 25 16:06:51 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:52 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd" returned: 0 in 1.707s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:52 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd Sep 25 16:06:52 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:52 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76.b8bb3a2d-7260-4f02-9997-eaceed10e964" returned: 0 in 1.100s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-quobyte-b8bb3a2d-7260-4f02-9997-eaceed10e964" released by "_delete_snapshot" :: held 4.622s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-quobyte-e9a73a03-f122-4d51-9cb7-6a8974263b76" released by "delete_snapshot" :: held 4.706s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:52 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-072471ac-af5e-40ad-ad06-6480414f3fcd" returned: 0 in 0.786s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-072471ac-af5e-40ad-ad06-6480414f3fcd" released by "delete_volume" :: held 2.732s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-e15fc8f8-848d-4f63-8a72-d01fdec23374" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:53 devstack cinder-volume[87314]: WARNING cinder.quota [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:06:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-e15fc8f8-848d-4f63-8a72-d01fdec23374" acquired by "delete_volume" :: waited 0.108s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:53 devstack cinder-volume[87314]: DEBUG cinder.quota [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Created reservations ['7827d7cc-f309-44c7-abfe-3724702d8b38', 'e26021fd-0a3a-4918-9302-41fa3a91c6e4', '1c36e423-0302-452a-9a5c-e9ba85d1c8a5', 'b608f469-6cd1-42bc-82dc-cae0af39e92e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e2d2a7-244e-46a4-bfdf-dbff13124deb]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Delete snapshot completed successfully. Sep 25 16:06:53 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 Sep 25 16:06:53 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b79ff3a1-a463-4a31-8632-a88dd621aa48 req-a8782619-94bc-4ec3-9e42-b9a7e7faafcb tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-b8bb3a2d-7260-4f02-9997-eaceed10e964-delete_snapshot" released by "delete_snapshot" :: held 5.483s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:54 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374" returned: 0 in 0.877s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:54 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374 Sep 25 16:06:54 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Acquiring lock "cinder-e9a73a03-f122-4d51-9cb7-6a8974263b76-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Flow 'volume_create_manager' (9b83b257-513e-4f28-a95a-b5241396ce3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebff188-8df0-429e-8317-86f1a554e678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-e9a73a03-f122-4d51-9cb7-6a8974263b76-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebff188-8df0-429e-8317-86f1a554e678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-389809434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861eca07-a5c5-4f68-b706-efc8f5d29c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8eac85edd02439599b40f6569100421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:54Z,use_quota=True,user_id='f5cd423cf5104209b4c31104a9455768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba10740-1489-4197-8357-76804e2046d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba10740-1489-4197-8357-76804e2046d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c926c77-62eb-49f4-80ae-638f720fd274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c926c77-62eb-49f4-80ae-638f720fd274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861eca07-a5c5-4f68-b706-efc8f5d29c6d', 'volume_name': 'volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713b238d-2b25-4a53-9a11-f63e2725aa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713b238d-2b25-4a53-9a11-f63e2725aa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403fe604-b009-4323-be0d-d04d3f5cf596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Volume 861eca07-a5c5-4f68-b706-efc8f5d29c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d', 'volume_size': 1} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-389809434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861eca07-a5c5-4f68-b706-efc8f5d29c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8eac85edd02439599b40f6569100421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:54Z,use_quota=True,user_id='f5cd423cf5104209b4c31104a9455768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Creating volume 861eca07-a5c5-4f68-b706-efc8f5d29c6d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:54 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:54 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d 1073741824 Sep 25 16:06:54 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Acquiring lock "cinder-quobyte-e9a73a03-f122-4d51-9cb7-6a8974263b76" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-quobyte-e9a73a03-f122-4d51-9cb7-6a8974263b76" acquired by "delete_volume" :: waited 0.049s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:54 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e15fc8f8-848d-4f63-8a72-d01fdec23374" returned: 0 in 0.849s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb98d8d-415d-45fc-80c4-30d0b850421c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-e15fc8f8-848d-4f63-8a72-d01fdec23374" released by "delete_volume" :: held 1.987s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Created reservations ['c1bd6e49-2246-4320-8332-378f90c7e01d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:55 devstack cinder-volume[87314]: WARNING cinder.quota [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-643913415 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-643913415, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:06:55 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 Sep 25 16:06:55 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Created reservations ['409b1773-e7ab-4a93-921d-84be7cf56e1a', '4d02ac4e-5f42-44a5-a14b-34861b0fd950', '3d4f4ee0-bdc2-4794-8beb-7156c6aa6aea', '7dddda6e-1a25-47bf-97aa-ca12f6644b31'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Created reservations ['66bd957d-68d5-4f8c-99ca-55ce63b08880', 'bbb0ffe3-6ea2-4d3e-8802-030bcd30157a', '2d923d78-066e-4e2e-934b-2460d603e9a2', 'c474ba8a-0b89-4703-a448-d6441d6aef06'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:55 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d 1073741824" returned: 0 in 0.988s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:55 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d Sep 25 16:06:55 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:56 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76" returned: 0 in 1.008s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:56 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:06:56 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:56 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76 Sep 25 16:06:56 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:56 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9a73a03-f122-4d51-9cb7-6a8974263b76" returned: 0 in 0.507s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-quobyte-e9a73a03-f122-4d51-9cb7-6a8974263b76" released by "delete_volume" :: held 1.664s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:56 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d" returned: 0 in 0.918s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403fe604-b009-4323-be0d-d04d3f5cf596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486fded2-1c5c-413f-93a5-d99173a978a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:56 devstack cinder-volume[87314]: DEBUG cinder.quota [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Created reservations ['5d23af00-f5cc-4840-a89e-07ec393d897d', '5513c5e2-084c-448e-9e78-fbfa66a90f3d', 'b89706a6-2cd0-4c25-a143-0f0bb5e64b47', 'e057e7d4-1e8a-4f8d-85e1-ca4ccfe97735'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:57 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Volume volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d (861eca07-a5c5-4f68-b706-efc8f5d29c6d): created successfully Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486fded2-1c5c-413f-93a5-d99173a978a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Flow 'volume_create_manager' (9b83b257-513e-4f28-a95a-b5241396ce3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fa49412b-2118-4653-b984-50652ee1dc9d tempest-ServerRescueNegativeTestJSON-631116797 None] Created volume successfully. Sep 25 16:06:57 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 1.054s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5ba31d03-99a1-47c2-a759-b89c41dd59f7 tempest-GroupSnapshotsTest-438921265 None] Delete group completed successfully. Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:57 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:06:57 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b7ec4a16-bff6-44d3-8943-42a17f95ff30 tempest-GroupSnapshotsTest-438921265 None] Group tempest-GroupSnapshotsTest-Group-1169391653: creating Sep 25 16:06:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b7ec4a16-bff6-44d3-8943-42a17f95ff30 tempest-GroupSnapshotsTest-438921265 None] Group tempest-GroupSnapshotsTest-Group-1169391653: created successfully Sep 25 16:06:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b7ec4a16-bff6-44d3-8943-42a17f95ff30 tempest-GroupSnapshotsTest-438921265 None] Create group completed successfully. Sep 25 16:06:57 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.419s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG cinder.manager [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Deleted volume successfully. Sep 25 16:06:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e63f1d8c-f705-4512-8b1c-20757666e73f req-38d64a07-9209-4c52-9233-226e56f93e46 tempest-VolumesSnapshotsTestJSON-320699860 None] Lock "cinder-e9a73a03-f122-4d51-9cb7-6a8974263b76-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:06:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:58 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:06:58 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:59 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.741s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:06:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 8 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:06:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=95,cinder:UPDATE=103,cinder:INSERT=28,cinder:DELETE=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=109,cinder:SELECT=102,cinder:INSERT=23,cinder:DELETE=4 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Flow 'volume_create_manager' (89eee6a3-798f-46c6-bfc8-14e1b191552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad4af7d-a027-4f24-9ecf-ea7956d5249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad4af7d-a027-4f24-9ecf-ea7956d5249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1788941276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac09c311-00cd-4cc7-a657-79e580935983,host='devstack@QuobyteHD#QuobyteHD',id=77f7f18a-71f4-4147-99b1-154733ec8a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa554799b93f4d628305f273168c4a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:00Z,use_quota=True,user_id='29413405d9e64e5c9c6a0949dca021e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdefbc0a-1e30-421c-8f91-a382d4385f18),volume_type_id=fdefbc0a-1e30-421c-8f91-a382d4385f18)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3311a3ab-ffcd-42b4-831e-fbb9b67238cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3311a3ab-ffcd-42b4-831e-fbb9b67238cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4862410e-034f-45d3-b265-8ef1791b195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4862410e-034f-45d3-b265-8ef1791b195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f7f18a-71f4-4147-99b1-154733ec8a89', 'volume_name': 'volume-77f7f18a-71f4-4147-99b1-154733ec8a89', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11329601-67df-4dd0-b6f7-0ba0d3363cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11329601-67df-4dd0-b6f7-0ba0d3363cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3f9ff1-30d9-4079-ad2d-ab16995aaace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Volume 77f7f18a-71f4-4147-99b1-154733ec8a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f7f18a-71f4-4147-99b1-154733ec8a89', 'volume_size': 1} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ac09c311-00cd-4cc7-a657-79e580935983,created_at=2026-09-25T14:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1788941276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac09c311-00cd-4cc7-a657-79e580935983,host='devstack@QuobyteHD#QuobyteHD',id=77f7f18a-71f4-4147-99b1-154733ec8a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa554799b93f4d628305f273168c4a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:00Z,use_quota=True,user_id='29413405d9e64e5c9c6a0949dca021e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdefbc0a-1e30-421c-8f91-a382d4385f18),volume_type_id=fdefbc0a-1e30-421c-8f91-a382d4385f18)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Creating volume 77f7f18a-71f4-4147-99b1-154733ec8a89 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:00 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:07:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:00 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 1073741824 Sep 25 16:07:00 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:01 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 1073741824" returned: 0 in 1.033s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:01 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 Sep 25 16:07:01 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:02 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89" returned: 0 in 0.587s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3f9ff1-30d9-4079-ad2d-ab16995aaace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f7f18a-71f4-4147-99b1-154733ec8a89', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66de6c84-6600-4f92-8091-5d35d6d4adcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Volume volume-77f7f18a-71f4-4147-99b1-154733ec8a89 (77f7f18a-71f4-4147-99b1-154733ec8a89): created successfully Sep 25 16:07:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66de6c84-6600-4f92-8091-5d35d6d4adcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Flow 'volume_create_manager' (89eee6a3-798f-46c6-bfc8-14e1b191552e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bcc05a0e-71b5-44f3-8a48-57df1ee70de6 tempest-GroupSnapshotsTest-438921265 None] Created volume successfully. Sep 25 16:07:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] GroupSnapshot 7afbeb2a-9cdd-40af-a262-3554a6b9713c: creating. Sep 25 16:07:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Group snapshot 7afbeb2a-9cdd-40af-a262-3554a6b9713c: creating. {{(pid=87314) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:07:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Creating offline snapshot 849df6f6-1831-4ffb-81d9-663b94940c21 of volume 77f7f18a-71f4-4147-99b1-154733ec8a89 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:03 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c22d4c-39bc-41b1-b6fa-64340613a89d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:03 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 Sep 25 16:07:03 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:04 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89" returned: 0 in 0.638s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:04 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 1G Sep 25 16:07:04 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:05 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 1G" returned: 0 in 0.790s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f7f18a-71f4-4147-99b1-154733ec8a89 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:05 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f7f18a-71f4-4147-99b1-154733ec8a89 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 Sep 25 16:07:05 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:05 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f7f18a-71f4-4147-99b1-154733ec8a89 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21" returned: 0 in 0.675s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:05 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:07:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:06 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 Sep 25 16:07:06 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:06 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21" returned: 0 in 0.764s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:06 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.info Sep 25 16:07:06 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:07 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.info" returned: 0 in 0.772s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:07 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:07:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:07 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.info Sep 25 16:07:07 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-62ad9fa8-54c5-4012-a36a-7a434037853e tempest-GroupsTest-1711939634 None] Group tempest-Group1-752059508: creating Sep 25 16:07:08 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.info" returned: 0 in 0.584s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.381s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-62ad9fa8-54c5-4012-a36a-7a434037853e tempest-GroupsTest-1711939634 None] Group tempest-Group1-752059508: created successfully Sep 25 16:07:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-62ad9fa8-54c5-4012-a36a-7a434037853e tempest-GroupsTest-1711939634 None] Create group completed successfully. Sep 25 16:07:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-17fe30e0-368b-4d05-b12d-d25aab157bb2 tempest-GroupSnapshotsTest-438921265 None] group_snapshot 7afbeb2a-9cdd-40af-a262-3554a6b9713c: created successfully Sep 25 16:07:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] group_snapshot 7afbeb2a-9cdd-40af-a262-3554a6b9713c: deleting Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] group_snapshot 7afbeb2a-9cdd-40af-a262-3554a6b9713c: deleting {{(pid=87314) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-77f7f18a-71f4-4147-99b1-154733ec8a89" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-77f7f18a-71f4-4147-99b1-154733ec8a89" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-849df6f6-1831-4ffb-81d9-663b94940c21" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-849df6f6-1831-4ffb-81d9-663b94940c21" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Deleting offline snapshot 849df6f6-1831-4ffb-81d9-663b94940c21 of volume 77f7f18a-71f4-4147-99b1-154733ec8a89 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] snapshot_file for this snap is: volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd273d-3f13-4572-bc10-8aac4743a760]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:08 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 Sep 25 16:07:08 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:09 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21" returned: 0 in 0.617s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77f7f18a-71f4-4147-99b1-154733ec8a89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[659638f9-d53e-4873-a471-c0ebedd63d94]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3df37a05-c825-4f32-8a35-3bb51b4eb273 tempest-GroupsTest-1711939634 None] Group tempest-Group2-571574062: creating Sep 25 16:07:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3df37a05-c825-4f32-8a35-3bb51b4eb273 tempest-GroupsTest-1711939634 None] Group tempest-Group2-571574062: created successfully Sep 25 16:07:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3df37a05-c825-4f32-8a35-3bb51b4eb273 tempest-GroupsTest-1711939634 None] Create group completed successfully. Sep 25 16:07:09 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 Sep 25 16:07:09 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:10 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89" returned: 0 in 0.545s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:10 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 Sep 25 16:07:10 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:10 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21" returned: 0 in 0.430s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:10 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21 Sep 25 16:07:10 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:10 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89.849df6f6-1831-4ffb-81d9-663b94940c21" returned: 0 in 0.314s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-849df6f6-1831-4ffb-81d9-663b94940c21" released by "_delete_snapshot" :: held 2.086s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-77f7f18a-71f4-4147-99b1-154733ec8a89" released by "delete_snapshot" :: held 2.127s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:11 devstack cinder-volume[87314]: WARNING cinder.quota [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-457582541 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-457582541, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:11 devstack cinder-volume[87314]: WARNING cinder.quota [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-457582541 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-457582541, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] Created reservations ['3e73bc42-e88d-4ef5-8d66-93de1d25ba8a', 'ec291036-e71e-412c-a252-8bb59260621e', '5c5fa25f-a774-4f97-affd-c84f6eb77369', 'eca54ff7-fe1b-45b2-9200-aceeaa3fc6e4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a849014e-d662-4704-94d7-5698975e2e87 tempest-GroupSnapshotsTest-438921265 None] group_snapshot 7afbeb2a-9cdd-40af-a262-3554a6b9713c: deleted successfully Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Flow 'volume_create_manager' (1f825ce5-2196-4f2b-93d4-33c510d772a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c00b65-5965-419c-8175-e198a733e6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c00b65-5965-419c-8175-e198a733e6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1516015132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95f62e3b-51ff-4b1f-af41-b2d46da8bff7,host='devstack@QuobyteHD#QuobyteHD',id=6e957b1f-d72e-48ba-868e-34dfe5f7d518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a02e914e59d446dbdff557ce46700c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:11Z,use_quota=True,user_id='7ff263300da84f3f8c34f55fff3e9734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(663f0527-d59b-4510-9e81-0437bb4a1b18),volume_type_id=663f0527-d59b-4510-9e81-0437bb4a1b18)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57eeeefc-24e8-499d-8c1b-3290ea73744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57eeeefc-24e8-499d-8c1b-3290ea73744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0906a6-b377-4718-bd62-483b2dda0e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0906a6-b377-4718-bd62-483b2dda0e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e957b1f-d72e-48ba-868e-34dfe5f7d518', 'volume_name': 'volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3d68ae-3935-4086-b1b7-87d989d345b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3d68ae-3935-4086-b1b7-87d989d345b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccae4b5-4359-47f8-a1ab-ddd20999936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Volume 6e957b1f-d72e-48ba-868e-34dfe5f7d518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518', 'volume_size': 1} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95f62e3b-51ff-4b1f-af41-b2d46da8bff7,created_at=2026-09-25T14:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1516015132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95f62e3b-51ff-4b1f-af41-b2d46da8bff7,host='devstack@QuobyteHD#QuobyteHD',id=6e957b1f-d72e-48ba-868e-34dfe5f7d518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a02e914e59d446dbdff557ce46700c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:11Z,use_quota=True,user_id='7ff263300da84f3f8c34f55fff3e9734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(663f0527-d59b-4510-9e81-0437bb4a1b18),volume_type_id=663f0527-d59b-4510-9e81-0437bb4a1b18)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Creating volume 6e957b1f-d72e-48ba-868e-34dfe5f7d518 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:07:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:11 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 1073741824 Sep 25 16:07:11 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:12 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 1073741824" returned: 0 in 0.729s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:12 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 Sep 25 16:07:12 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "cinder-quobyte-77f7f18a-71f4-4147-99b1-154733ec8a89" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-77f7f18a-71f4-4147-99b1-154733ec8a89" acquired by "delete_volume" :: waited 0.045s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:13 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518" returned: 0 in 0.746s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d4951-f1dd-417a-b57b-c8d4807b5248]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccae4b5-4359-47f8-a1ab-ddd20999936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7057745-5dc1-4276-8245-ac75556945ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Volume volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 (6e957b1f-d72e-48ba-868e-34dfe5f7d518): created successfully Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7057745-5dc1-4276-8245-ac75556945ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Flow 'volume_create_manager' (1f825ce5-2196-4f2b-93d4-33c510d772a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-747932f1-a480-4379-941f-b93613e5c9de tempest-GroupsTest-1711939634 None] Created volume successfully. Sep 25 16:07:13 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 Sep 25 16:07:13 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Acquiring lock "cinder-861eca07-a5c5-4f68-b706-efc8f5d29c6d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "cinder-861eca07-a5c5-4f68-b706-efc8f5d29c6d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Acquiring lock "cinder-quobyte-861eca07-a5c5-4f68-b706-efc8f5d29c6d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "cinder-quobyte-861eca07-a5c5-4f68-b706-efc8f5d29c6d" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d734fea-239e-4656-97bf-f725c9f1dbd4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:13 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d Sep 25 16:07:13 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:13 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89" returned: 0 in 0.679s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:13 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89 Sep 25 16:07:13 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:14 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-77f7f18a-71f4-4147-99b1-154733ec8a89" returned: 0 in 0.333s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Lock "cinder-quobyte-77f7f18a-71f4-4147-99b1-154733ec8a89" released by "delete_volume" :: held 1.168s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:14 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d" returned: 0 in 0.632s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:14 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d Sep 25 16:07:14 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Created reservations ['636c42cc-23c5-4e32-aecb-1316b4aae69d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:14 devstack cinder-volume[87314]: WARNING cinder.quota [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-457582541 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-457582541, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Created reservations ['5bde40b8-faf1-40a4-ac8e-4d0aac2ae2f1', '8cbfb6ef-4928-4a12-945b-ddb5250a61a2', 'd576d867-143e-42d0-84ef-d455281350bc', 'b60c1a65-37cf-4daa-a13b-e71ce64f2c4c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:14 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:07:14 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:15 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-861eca07-a5c5-4f68-b706-efc8f5d29c6d" returned: 0 in 0.783s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "cinder-quobyte-861eca07-a5c5-4f68-b706-efc8f5d29c6d" released by "delete_volume" :: held 1.503s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:15 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.432s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0cbcbca4-861c-4a92-90ca-81d9f8ccec12 tempest-GroupSnapshotsTest-438921265 None] Delete group completed successfully. Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Created reservations ['a4cdd638-01b2-4b5e-9ebe-446567465f5a', '93663ed4-a4a6-41ea-91d2-0dcf05723774', '04b94cdf-e4fa-416e-8c46-e1e92a2d6f9d', '67ff2eb2-e15a-435b-9474-f274294806f4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:15 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:07:15 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Acquiring lock "cinder-quobyte-6e957b1f-d72e-48ba-868e-34dfe5f7d518" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Lock "cinder-quobyte-6e957b1f-d72e-48ba-868e-34dfe5f7d518" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009bf76-ecfd-4063-9485-d0eb766b2016]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:15 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.384s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Deleted volume successfully. Sep 25 16:07:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65aae2f8-59f0-49a5-a6a1-decbaf789236 tempest-ServerRescueNegativeTestJSON-631116797 None] Lock "cinder-861eca07-a5c5-4f68-b706-efc8f5d29c6d-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:15 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 Sep 25 16:07:15 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:16 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518" returned: 0 in 0.858s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:16 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518 Sep 25 16:07:16 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:17 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e957b1f-d72e-48ba-868e-34dfe5f7d518" returned: 0 in 0.628s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Lock "cinder-quobyte-6e957b1f-d72e-48ba-868e-34dfe5f7d518" released by "delete_volume" :: held 1.621s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Created reservations ['306953e8-da1f-4bd0-8d55-4bb4746fdc5e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:17 devstack cinder-volume[87314]: WARNING cinder.quota [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1224591607 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1224591607, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:17 devstack cinder-volume[87314]: WARNING cinder.quota [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1224591607 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1224591607, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Created reservations ['ef74a0c9-df86-400c-9602-97e4a1f92223', '296e2dbf-624d-4614-b2bb-dc973506d660', 'c02105f3-9c9f-4547-acaf-b6bb1c3a1c95', 'c2497bbc-3756-4044-9047-38c24805c47c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:17 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:07:17 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:18 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.444s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:18 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9768ba7f-96a7-49e7-afd1-c72f5f641717 tempest-GroupsTest-1711939634 None] Delete group completed successfully. Sep 25 16:07:18 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] Created reservations ['b665ccf6-7db1-45f7-bfc9-c41f6064cb4a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:19 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:07:19 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:19 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.448s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:19 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-432a726e-230c-43fd-bd41-e501519eab55 tempest-GroupsTest-1711939634 None] Delete group completed successfully. Sep 25 16:07:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0f151418-50c2-428a-8587-a746705bd72f tempest-GroupsTest-1711939634 None] Group tempest-GroupsTest-Group-508314513: creating Sep 25 16:07:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0f151418-50c2-428a-8587-a746705bd72f tempest-GroupsTest-1711939634 None] Group tempest-GroupsTest-Group-508314513: created successfully Sep 25 16:07:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0f151418-50c2-428a-8587-a746705bd72f tempest-GroupsTest-1711939634 None] Create group completed successfully. Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Flow 'volume_create_manager' (f95c04e6-d163-4ea8-82d0-6e7fe624e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa5e8ae-2d39-4ff1-89b4-6b7016ef75e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa5e8ae-2d39-4ff1-89b4-6b7016ef75e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-585430351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36ac78c8-695f-43d1-9bdf-410b26cbd410,host='devstack@QuobyteHD#QuobyteHD',id=48793c02-9683-463f-a3ff-5217ebcfcdb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a02e914e59d446dbdff557ce46700c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:23Z,use_quota=True,user_id='7ff263300da84f3f8c34f55fff3e9734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83e740c0-cb00-416f-95c6-cf4b210d6f92),volume_type_id=83e740c0-cb00-416f-95c6-cf4b210d6f92)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22820b7-ec94-4f7e-a41f-3297d00b84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22820b7-ec94-4f7e-a41f-3297d00b84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90582db-7332-4305-9842-a991dc8d3265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90582db-7332-4305-9842-a991dc8d3265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48793c02-9683-463f-a3ff-5217ebcfcdb2', 'volume_name': 'volume-48793c02-9683-463f-a3ff-5217ebcfcdb2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af25901-bf62-475d-a79b-3120a8dfc47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af25901-bf62-475d-a79b-3120a8dfc47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9e51f5-fc9e-42f8-b296-0eba7f0cdcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Volume 48793c02-9683-463f-a3ff-5217ebcfcdb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48793c02-9683-463f-a3ff-5217ebcfcdb2', 'volume_size': 1} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36ac78c8-695f-43d1-9bdf-410b26cbd410,created_at=2026-09-25T14:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-585430351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36ac78c8-695f-43d1-9bdf-410b26cbd410,host='devstack@QuobyteHD#QuobyteHD',id=48793c02-9683-463f-a3ff-5217ebcfcdb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a02e914e59d446dbdff557ce46700c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:23Z,use_quota=True,user_id='7ff263300da84f3f8c34f55fff3e9734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83e740c0-cb00-416f-95c6-cf4b210d6f92),volume_type_id=83e740c0-cb00-416f-95c6-cf4b210d6f92)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Creating volume 48793c02-9683-463f-a3ff-5217ebcfcdb2 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:22 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:07:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:22 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 1073741824 Sep 25 16:07:22 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:23 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 1073741824" returned: 0 in 0.619s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:23 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 Sep 25 16:07:23 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:23 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2" returned: 0 in 0.291s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9e51f5-fc9e-42f8-b296-0eba7f0cdcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48793c02-9683-463f-a3ff-5217ebcfcdb2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a870105-968c-4112-8fb9-c99fb05298ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Volume volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 (48793c02-9683-463f-a3ff-5217ebcfcdb2): created successfully Sep 25 16:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a870105-968c-4112-8fb9-c99fb05298ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Flow 'volume_create_manager' (f95c04e6-d163-4ea8-82d0-6e7fe624e22e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4c953bc9-ae37-426a-9102-597f8d1586fc tempest-GroupsTest-1711939634 None] Created volume successfully. Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Flow 'volume_create_manager' (5b343693-de0a-4e18-b545-7379a3f86cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63108318-9a32-42ec-8486-05c3c89dd591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63108318-9a32-42ec-8486-05c3c89dd591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480838158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36ac78c8-695f-43d1-9bdf-410b26cbd410,host='devstack@QuobyteHD#QuobyteHD',id=682bd2c1-7848-4edd-b7ad-f602bd3e4c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a02e914e59d446dbdff557ce46700c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:25Z,use_quota=True,user_id='7ff263300da84f3f8c34f55fff3e9734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83e740c0-cb00-416f-95c6-cf4b210d6f92),volume_type_id=83e740c0-cb00-416f-95c6-cf4b210d6f92)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0b3524-ddab-4c06-b57d-ada86946893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0b3524-ddab-4c06-b57d-ada86946893a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87f7ef7-258e-4505-91fb-056e9c28a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87f7ef7-258e-4505-91fb-056e9c28a357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '682bd2c1-7848-4edd-b7ad-f602bd3e4c42', 'volume_name': 'volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bbc864-34a4-4aa5-9268-783142a82688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bbc864-34a4-4aa5-9268-783142a82688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438d12c8-39c7-432e-9f20-bf6cfed666cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:24 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Volume 682bd2c1-7848-4edd-b7ad-f602bd3e4c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42', 'volume_size': 1} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36ac78c8-695f-43d1-9bdf-410b26cbd410,created_at=2026-09-25T14:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480838158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36ac78c8-695f-43d1-9bdf-410b26cbd410,host='devstack@QuobyteHD#QuobyteHD',id=682bd2c1-7848-4edd-b7ad-f602bd3e4c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a02e914e59d446dbdff557ce46700c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:25Z,use_quota=True,user_id='7ff263300da84f3f8c34f55fff3e9734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83e740c0-cb00-416f-95c6-cf4b210d6f92),volume_type_id=83e740c0-cb00-416f-95c6-cf4b210d6f92)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Creating volume 682bd2c1-7848-4edd-b7ad-f602bd3e4c42 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:24 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:07:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:24 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 1073741824 Sep 25 16:07:24 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:25 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 1073741824" returned: 0 in 0.674s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:25 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 Sep 25 16:07:25 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5ea631cb-3985-4c44-bd9a-67ca8c633d2a tempest-GroupSnapshotsV319Test-968532471 None] Group tempest-GroupSnapshotsV319Test-Group-1702653361: creating Sep 25 16:07:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5ea631cb-3985-4c44-bd9a-67ca8c633d2a tempest-GroupSnapshotsV319Test-968532471 None] Group tempest-GroupSnapshotsV319Test-Group-1702653361: created successfully Sep 25 16:07:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5ea631cb-3985-4c44-bd9a-67ca8c633d2a tempest-GroupSnapshotsV319Test-968532471 None] Create group completed successfully. Sep 25 16:07:25 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42" returned: 0 in 0.316s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438d12c8-39c7-432e-9f20-bf6cfed666cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3f6078-55fe-41c7-8253-6bc0d2f9bb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:25 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Volume volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 (682bd2c1-7848-4edd-b7ad-f602bd3e4c42): created successfully Sep 25 16:07:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3f6078-55fe-41c7-8253-6bc0d2f9bb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Flow 'volume_create_manager' (5b343693-de0a-4e18-b545-7379a3f86cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4a25b4a3-5a02-493b-a124-1e3dcb2c6d8b tempest-GroupsTest-1711939634 None] Created volume successfully. Sep 25 16:07:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6a63825b-cfb9-46c1-8690-9444a7ab2a5e tempest-GroupsTest-1711939634 None] Update group completed successfully. Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Flow 'volume_create_manager' (8d06800f-e768-492e-9982-afb410fe35df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a502d850-58fb-4e21-b8fa-34b9cba34c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a502d850-58fb-4e21-b8fa-34b9cba34c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-302644389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af176763-abe5-452c-bed8-22146c03ce6b,host='devstack@QuobyteHD#QuobyteHD',id=19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b715a2287a14925b61f4202849122a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:27Z,use_quota=True,user_id='15df08d59c9c4027a7e1a1a5c9a62017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46d0510f-5aeb-49fe-ad72-0ab58b258b51),volume_type_id=46d0510f-5aeb-49fe-ad72-0ab58b258b51)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f40b652-8915-4942-bc2c-fdb72896f08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f40b652-8915-4942-bc2c-fdb72896f08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986bec95-9a68-4c83-adf8-eaa9e2ef0d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986bec95-9a68-4c83-adf8-eaa9e2ef0d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3', 'volume_name': 'volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491b552a-5130-4f30-b6a3-8714961f69fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491b552a-5130-4f30-b6a3-8714961f69fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328a5003-0680-4282-85fd-2a860ff17fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Volume 19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3', 'volume_size': 1} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=af176763-abe5-452c-bed8-22146c03ce6b,created_at=2026-09-25T14:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-302644389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af176763-abe5-452c-bed8-22146c03ce6b,host='devstack@QuobyteHD#QuobyteHD',id=19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b715a2287a14925b61f4202849122a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:27Z,use_quota=True,user_id='15df08d59c9c4027a7e1a1a5c9a62017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46d0510f-5aeb-49fe-ad72-0ab58b258b51),volume_type_id=46d0510f-5aeb-49fe-ad72-0ab58b258b51)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Creating volume 19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:27 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:07:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:27 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 1073741824 Sep 25 16:07:27 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:28 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Flow 'volume_create_manager' (d84cc895-6b34-41c6-9711-80c2538d3626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1433f9b4-63a1-4b61-9df4-ae1e52835840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 1073741824" returned: 0 in 0.655s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1433f9b4-63a1-4b61-9df4-ae1e52835840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-542484331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d391d4-fe90-4b2e-9822-105038d66767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27544bc69ec043ffa66a3935ae0e8acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:28Z,use_quota=True,user_id='75ca6bfdae0748e1bc24a76518118798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82d82f1-da39-4d78-b497-83d158adc2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82d82f1-da39-4d78-b497-83d158adc2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070116b6-de87-4e7a-a39e-f2a1fac43e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070116b6-de87-4e7a-a39e-f2a1fac43e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d391d4-fe90-4b2e-9822-105038d66767', 'volume_name': 'volume-c7d391d4-fe90-4b2e-9822-105038d66767', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5f7eaa-655d-4aaa-9d82-e6ac177e7795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5f7eaa-655d-4aaa-9d82-e6ac177e7795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4941fa40-7cc1-4632-a189-3cc276278cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Volume c7d391d4-fe90-4b2e-9822-105038d66767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d391d4-fe90-4b2e-9822-105038d66767', 'volume_size': 1} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:28 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 Sep 25 16:07:28 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:28 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-542484331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d391d4-fe90-4b2e-9822-105038d66767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27544bc69ec043ffa66a3935ae0e8acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:28Z,use_quota=True,user_id='75ca6bfdae0748e1bc24a76518118798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Creating volume c7d391d4-fe90-4b2e-9822-105038d66767 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:28 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328a5003-0680-4282-85fd-2a860ff17fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:28 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767 1073741824 Sep 25 16:07:28 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f447f8-c61d-45a8-b968-20065c396013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Volume volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 (19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3): created successfully Sep 25 16:07:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f447f8-c61d-45a8-b968-20065c396013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Flow 'volume_create_manager' (8d06800f-e768-492e-9982-afb410fe35df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ca238523-491c-4732-a054-f1312322b4bd tempest-GroupSnapshotsV319Test-968532471 None] Created volume successfully. Sep 25 16:07:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a63580cf-9bb8-424f-9e98-8599cd814d45 tempest-GroupsTest-1711939634 None] Update group completed successfully. Sep 25 16:07:29 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767 1073741824" returned: 0 in 0.748s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:29 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767 Sep 25 16:07:29 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:30 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4941fa40-7cc1-4632-a189-3cc276278cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d391d4-fe90-4b2e-9822-105038d66767', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934d033e-01cd-432a-8ccb-c5a1d4a532cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Volume volume-c7d391d4-fe90-4b2e-9822-105038d66767 (c7d391d4-fe90-4b2e-9822-105038d66767): created successfully Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934d033e-01cd-432a-8ccb-c5a1d4a532cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Flow 'volume_create_manager' (d84cc895-6b34-41c6-9711-80c2538d3626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7ae1c2ef-e489-419e-90e6-e29937ec3f04 tempest-ServerActionsTestOtherA-1750413974 None] Created volume successfully. Sep 25 16:07:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] GroupSnapshot 03d6101c-00cb-44a6-b2ae-5dc457f84073: creating. Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Group snapshot 03d6101c-00cb-44a6-b2ae-5dc457f84073: creating. {{(pid=87314) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Creating offline snapshot 8c21c976-8f40-41c3-a425-94e50b1e3787 of volume 19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[45836ddf-8b70-4caf-b60c-acd1537ef2a6]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:30 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 Sep 25 16:07:30 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:31 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" returned: 0 in 0.518s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Acquiring lock "cinder-quobyte-48793c02-9683-463f-a3ff-5217ebcfcdb2" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:31 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 1G Sep 25 16:07:31 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Lock "cinder-quobyte-48793c02-9683-463f-a3ff-5217ebcfcdb2" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cd3cb0-a81a-4df8-a5eb-9096eb873941]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:31 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 Sep 25 16:07:31 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:31 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 1G" returned: 0 in 0.736s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:32 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 Sep 25 16:07:32 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:32 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2" returned: 0 in 0.658s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:32 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2 Sep 25 16:07:32 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:32 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48793c02-9683-463f-a3ff-5217ebcfcdb2" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Lock "cinder-quobyte-48793c02-9683-463f-a3ff-5217ebcfcdb2" released by "delete_volume" :: held 1.109s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Acquiring lock "cinder-quobyte-682bd2c1-7848-4edd-b7ad-f602bd3e4c42" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:32 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Lock "cinder-quobyte-682bd2c1-7848-4edd-b7ad-f602bd3e4c42" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787" returned: 0 in 0.478s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:32 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2628dff1-adb5-4374-8d3d-f5f787389ab8]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:32 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 Sep 25 16:07:32 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:32 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 Sep 25 16:07:32 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:32 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787" returned: 0 in 0.338s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:32 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.info Sep 25 16:07:32 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:32 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42" returned: 0 in 0.512s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:33 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42 Sep 25 16:07:33 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:33 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.info" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:33 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:07:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:33 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.info Sep 25 16:07:33 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:33 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-682bd2c1-7848-4edd-b7ad-f602bd3e4c42" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Lock "cinder-quobyte-682bd2c1-7848-4edd-b7ad-f602bd3e4c42" released by "delete_volume" :: held 0.936s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Created reservations ['afaac1cb-5d19-4cb1-851e-89f9d1afe9c9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:33 devstack cinder-volume[87314]: WARNING cinder.quota [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1822350755 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1822350755, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:33 devstack cinder-volume[87314]: WARNING cinder.quota [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1822350755 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1822350755, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:33 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.info" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Created reservations ['bda02ccb-61e9-49d1-a624-137649e42f67', '8feacdfb-302f-44ab-8079-0053717ca0ca', '3eca8ad4-18ab-4edf-a673-9b7bd1a7b328', 'd136303b-01b3-4a76-8b75-a4195c80304f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-378cbdc2-f895-4107-9203-8f22023d1e86 tempest-GroupSnapshotsV319Test-968532471 None] group_snapshot 03d6101c-00cb-44a6-b2ae-5dc457f84073: created successfully Sep 25 16:07:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Created reservations ['f6c1906f-1463-4c50-8a37-41b967764aec', '701910a2-0d60-4224-924d-edd0855101d5', 'a9cffdc9-d43e-4271-9d90-01b5c9ba91c0', 'f7edf72d-02b1-4058-af77-bf3ab1938e01'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:34 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:07:34 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:34 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.584s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fd0d0bfa-a103-4979-a1ee-75a834072151 tempest-GroupsTest-1711939634 None] Delete group completed successfully. Sep 25 16:07:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] group_snapshot 03d6101c-00cb-44a6-b2ae-5dc457f84073: deleting Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] group_snapshot 03d6101c-00cb-44a6-b2ae-5dc457f84073: deleting {{(pid=87314) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Acquiring lock "cinder-quobyte-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Lock "cinder-quobyte-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Acquiring lock "cinder-quobyte-8c21c976-8f40-41c3-a425-94e50b1e3787" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Lock "cinder-quobyte-8c21c976-8f40-41c3-a425-94e50b1e3787" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Deleting offline snapshot 8c21c976-8f40-41c3-a425-94e50b1e3787 of volume 19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] snapshot_file for this snap is: volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe4db1c-a040-449d-b536-81b1a9ef8f92]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:35 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 Sep 25 16:07:35 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:35 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787" returned: 0 in 0.725s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6957a1-3faf-4390-959a-b2d3c5178f91]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:35 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 Sep 25 16:07:35 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:36 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" returned: 0 in 0.631s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:36 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 Sep 25 16:07:36 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:36 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787" returned: 0 in 0.559s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:36 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787 Sep 25 16:07:36 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:37 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3.8c21c976-8f40-41c3-a425-94e50b1e3787" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Lock "cinder-quobyte-8c21c976-8f40-41c3-a425-94e50b1e3787" released by "_delete_snapshot" :: held 2.467s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Lock "cinder-quobyte-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" released by "delete_snapshot" :: held 2.507s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:37 devstack cinder-volume[87314]: WARNING cinder.quota [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-176315844 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-176315844, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:37 devstack cinder-volume[87314]: WARNING cinder.quota [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-176315844 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-176315844, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:37 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] Created reservations ['d5375bb3-9796-4f93-9c7a-fb6e84aa9045', 'e7224349-44b7-4143-9bba-a6ed54b44557', 'c2c4697e-d8a9-4580-b5fa-aa585267a9f6', '3bd9a327-44b3-4ce0-aab5-ecf85e5299c9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-729a5d64-4f7f-4f13-980b-28f4ad69caa1 tempest-GroupSnapshotsV319Test-968532471 None] group_snapshot 03d6101c-00cb-44a6-b2ae-5dc457f84073: deleted successfully Sep 25 16:07:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Acquiring lock "cinder-quobyte-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Lock "cinder-quobyte-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[273eb338-e7c0-4d90-8bc2-c469da7b99e6]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:38 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 Sep 25 16:07:38 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:39 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" returned: 0 in 0.568s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:39 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3 Sep 25 16:07:39 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:39 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Lock "cinder-quobyte-19cceebb-0c3e-4c85-9bb4-7b84b6cadeb3" released by "delete_volume" :: held 1.047s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Created reservations ['bffa965b-e1d5-4b06-b32a-8e969360a93b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:39 devstack cinder-volume[87314]: WARNING cinder.quota [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-176315844 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-176315844, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Created reservations ['7425be03-de80-41ba-8373-795dcbdf7f49', 'b88109b8-89c1-4242-a79e-733b6d2e40b6', 'da7d3cff-8089-46d9-98c0-9a85f4f0e540', 'b2304c4e-bd97-4364-8bff-cd184657c5aa'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:40 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:07:40 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:40 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ad294007-1eee-4452-882c-38b90fd48510 tempest-GroupSnapshotsV319Test-968532471 None] Delete group completed successfully. Sep 25 16:07:49 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Flow 'volume_create_manager' (958846c7-cc09-479d-afdd-ba664e1f0779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415f41d7-4d81-43bd-8127-51778094410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415f41d7-4d81-43bd-8127-51778094410e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-234224686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3900a31a-a07e-4a4b-80a7-6edfc868f44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e057b331804becbc00466bbe6841ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:50Z,use_quota=True,user_id='21ecc30752464a83b6e4e197f1bcda8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d218837-88c2-466c-bb35-a1794c265c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d218837-88c2-466c-bb35-a1794c265c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b8d82b-6d49-4757-a709-cdf6d487811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b8d82b-6d49-4757-a709-cdf6d487811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3900a31a-a07e-4a4b-80a7-6edfc868f44b', 'volume_name': 'volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7638414f-2aaf-413d-8dfc-3f9797d7c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7638414f-2aaf-413d-8dfc-3f9797d7c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18311c4-4d0d-40e8-9a04-797126573452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b', 'volume_size': 1} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-234224686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3900a31a-a07e-4a4b-80a7-6edfc868f44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e057b331804becbc00466bbe6841ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:50Z,use_quota=True,user_id='21ecc30752464a83b6e4e197f1bcda8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Creating volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:50 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:07:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:50 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b 1073741824 Sep 25 16:07:50 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:51 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b 1073741824" returned: 0 in 0.904s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:51 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b Sep 25 16:07:51 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:51 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b" returned: 0 in 0.742s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18311c4-4d0d-40e8-9a04-797126573452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9dfe0d-ac2e-45de-8317-cf39457211bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:51 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Volume volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b (3900a31a-a07e-4a4b-80a7-6edfc868f44b): created successfully Sep 25 16:07:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9dfe0d-ac2e-45de-8317-cf39457211bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Flow 'volume_create_manager' (958846c7-cc09-479d-afdd-ba664e1f0779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0a347ccd-86cb-4496-9339-f326556be3b7 tempest-SnapshotsActionsTest-499662135 None] Created volume successfully. Sep 25 16:07:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Creating offline snapshot b7034b33-e201-48bd-bcdc-0295b8862139 of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b100c6-e1f5-4832-ab23-a8c1348e7b62]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:53 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b Sep 25 16:07:53 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:54 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b" returned: 0 in 0.835s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:54 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 1G Sep 25 16:07:54 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:55 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 1G" returned: 0 in 0.745s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:55 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:07:55 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:55 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.458s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:55 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 is being set with open permissions: ugo+rw Sep 25 16:07:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:55 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:07:55 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:56 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:56 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.info Sep 25 16:07:56 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:56 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.info" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:56 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.info is being set with open permissions: ugo+rw Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:56 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.info Sep 25 16:07:56 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Flow 'volume_create_manager' (788da65d-e056-49e8-8ad4-59fab9156d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74577933-969b-441f-98af-b1271f99c9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74577933-969b-441f-98af-b1271f99c9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-659513356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2eaf5e5e5354943a8bb5e799dac81a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:57Z,use_quota=True,user_id='b8b9221781144e8e8c0b6fe98485cc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfb053a8-4323-4b11-bfc5-afd513c6bacf),volume_type_id=bfb053a8-4323-4b11-bfc5-afd513c6bacf)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfb96e3-3531-429c-ab5e-9483da3466e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfb96e3-3531-429c-ab5e-9483da3466e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc98ec0-515e-498e-8112-b3d95624b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc98ec0-515e-498e-8112-b3d95624b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af', 'volume_name': 'volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9af7544-eb3d-4f96-8812-c517826184dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9af7544-eb3d-4f96-8812-c517826184dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f45145f-3508-49e7-aa45-65bd96876a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Volume 6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af', 'volume_size': 1} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:56 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.info" returned: 0 in 0.466s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.406s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.099s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-659513356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2eaf5e5e5354943a8bb5e799dac81a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:57Z,use_quota=True,user_id='b8b9221781144e8e8c0b6fe98485cc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfb053a8-4323-4b11-bfc5-afd513c6bacf),volume_type_id=bfb053a8-4323-4b11-bfc5-afd513c6bacf)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Creating volume 6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:56 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:07:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:57 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af 1073741824 Sep 25 16:07:57 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ecfffeba-f34a-4a69-b0f8-cca6c642383e tempest-SnapshotsActionsTest-499662135 None] Create snapshot completed successfully Sep 25 16:07:57 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af 1073741824" returned: 0 in 0.671s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:57 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af Sep 25 16:07:57 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:58 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af" returned: 0 in 0.346s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f45145f-3508-49e7-aa45-65bd96876a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de271a5-3739-4b89-9306-a5a6d8a1dc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Volume volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af (6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af): created successfully Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de271a5-3739-4b89-9306-a5a6d8a1dc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Flow 'volume_create_manager' (788da65d-e056-49e8-8ad4-59fab9156d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-aa7739c4-fbf7-4524-b105-26afa3cf3916 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Created volume successfully. Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:58 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:07:58 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Creating offline snapshot d16bf77d-3e1b-4a17-83c2-753df05c654d of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:59 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.553s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:07:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 8 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:07:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:07:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f146ce5-87da-4ac2-bd5a-823f560717cc]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:59 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:07:59 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:00 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.856s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:00 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d 1G Sep 25 16:08:00 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8bed3a51-ede1-48e8-a08f-2bfb8f9b05b6 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8bed3a51-ede1-48e8-a08f-2bfb8f9b05b6 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8bed3a51-ede1-48e8-a08f-2bfb8f9b05b6 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8bed3a51-ede1-48e8-a08f-2bfb8f9b05b6 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8bed3a51-ede1-48e8-a08f-2bfb8f9b05b6 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bed3a51-ede1-48e8-a08f-2bfb8f9b05b6 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:00 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:08:00 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:00 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bed3a51-ede1-48e8-a08f-2bfb8f9b05b6 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:00 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8bed3a51-ede1-48e8-a08f-2bfb8f9b05b6 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8bed3a51-ede1-48e8-a08f-2bfb8f9b05b6 tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Retype volume completed successfully. Sep 25 16:08:01 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d 1G" returned: 0 in 1.001s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:01 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d Sep 25 16:08:01 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Acquiring lock "cinder-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "cinder-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=113,cinder:SELECT=117,cinder:INSERT=29,cinder:DELETE=5 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=105,cinder:INSERT=19,cinder:UPDATE=115,cinder:DELETE=5 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Acquiring lock "cinder-quobyte-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:01 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d" returned: 0 in 0.557s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:01 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d is being set with open permissions: ugo+rw Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "cinder-quobyte-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af" acquired by "delete_volume" :: waited 0.051s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:01 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d Sep 25 16:08:01 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf70db-48ea-4efd-b90a-289e0ae35573]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:01 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af Sep 25 16:08:01 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:01 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7a3fcb38-574f-4c3a-ac8b-03c611beef29 tempest-SnapshotsActionsTest-499662135 None] Create snapshot completed successfully Sep 25 16:08:02 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af" returned: 0 in 0.481s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:02 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af Sep 25 16:08:02 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-d16bf77d-3e1b-4a17-83c2-753df05c654d-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-d16bf77d-3e1b-4a17-83c2-753df05c654d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-quobyte-d16bf77d-3e1b-4a17-83c2-753df05c654d" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-d16bf77d-3e1b-4a17-83c2-753df05c654d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Deleting offline snapshot d16bf77d-3e1b-4a17-83c2-753df05c654d of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] snapshot_file for this snap is: volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc119845-4831-48e9-b8d8-233242128a0c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:02 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af" returned: 0 in 0.420s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "cinder-quobyte-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af" released by "delete_volume" :: held 0.982s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:02 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d Sep 25 16:08:02 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:02 devstack cinder-volume[87314]: WARNING cinder.quota [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:08:02 devstack cinder-volume[87314]: WARNING cinder.quota [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Created reservations ['b6173ee1-bb66-466f-bd32-db59eee337f2', '09a5571d-07e9-4a23-9501-99740ca4533f', '8118bed8-5a3d-4d9e-8950-54a35163a22f', 'cb4e46f3-f4c0-4f6e-a942-1f8f8e27219b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:02 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:08:02 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:03 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d" returned: 0 in 0.746s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9308db-7287-4a35-af78-17d2071f0557]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:03 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.502s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Deleted volume successfully. Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf5e073-7e5c-4c38-95ed-ecff4f5082ec tempest-VolumeRetypeWithoutMigrationTest-892091856 None] Lock "cinder-6abb1af7-97a4-41a6-80d6-8d6e5d3fd4af-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:03 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:03 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:03 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.473s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:03 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d Sep 25 16:08:03 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:04 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d" returned: 0 in 0.693s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:04 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d Sep 25 16:08:04 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:04 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.d16bf77d-3e1b-4a17-83c2-753df05c654d" returned: 0 in 0.397s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-d16bf77d-3e1b-4a17-83c2-753df05c654d" released by "_delete_snapshot" :: held 2.484s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" released by "delete_snapshot" :: held 2.521s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:05 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Created reservations ['bcf96db2-30f3-4104-977d-71665fd74df5', 'cc71adf8-1255-40ad-9b1b-934263f0a1de', 'bcc86fed-09b0-449a-a364-9961526dca39', 'f7ae3cca-f2fb-4db6-a67d-9696c0d33e75'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Delete snapshot completed successfully. Sep 25 16:08:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b52c5f77-902e-4e69-8d2e-c5953048e387 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-d16bf77d-3e1b-4a17-83c2-753df05c654d-delete_snapshot" released by "delete_snapshot" :: held 2.845s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Creating offline snapshot 0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:08:06 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8192964-c9b4-422b-ab53-a1997679dae6]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:06 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:06 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:06 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.489s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:06 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 1G Sep 25 16:08:06 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:07 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 1G" returned: 0 in 0.898s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:07 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 Sep 25 16:08:07 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:08 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8" returned: 0 in 0.601s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:08 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 is being set with open permissions: ugo+rw Sep 25 16:08:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:08 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 Sep 25 16:08:08 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:08 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8" returned: 0 in 0.409s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-41144944-2479-4b60-8190-41fa68872842 tempest-SnapshotsActionsTest-499662135 None] Create snapshot completed successfully Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-quobyte-0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Deleting offline snapshot 0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] snapshot_file for this snap is: volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e5ca4e-49ab-4d19-8b20-ff525c555357]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:10 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 Sep 25 16:08:10 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:10 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8" returned: 0 in 0.758s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f138e0-6984-4b19-8ffc-7931c6acde5d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:11 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:11 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:11 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.785s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:11 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 Sep 25 16:08:11 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:12 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8" returned: 0 in 0.564s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:12 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8 Sep 25 16:08:12 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:12 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8" released by "_delete_snapshot" :: held 2.726s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" released by "delete_snapshot" :: held 2.774s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:12 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Created reservations ['ea66e233-5d85-4a9d-b839-1ac31dc2b3b1', '1545cf0e-ef52-481a-921d-44efce295cca', '03ddaeae-f082-4e1b-a86b-b722f03510fe', 'e7b8cd46-cc05-4829-82c7-76c819eda5a3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Delete snapshot completed successfully. Sep 25 16:08:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cde88a4e-1c7c-4175-b332-9daace5ec5cc tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-0de14de1-b3dc-4fe6-b2c9-5025e6eebbe8-delete_snapshot" released by "delete_snapshot" :: held 3.099s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Creating offline snapshot 5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:08:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[90118bea-e32e-4e0d-9a8c-559270147516]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:14 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:14 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:15 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 1.187s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:15 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 1G Sep 25 16:08:15 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:16 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Flow 'volume_create_manager' (ff0c2745-c770-430f-8622-ae1651f2ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a6a40a-7b46-46c2-bb51-bb6e4b539787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 1G" returned: 0 in 0.837s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a6a40a-7b46-46c2-bb51-bb6e4b539787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-924113176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0bddde-8bdb-40d5-9275-b2873f166e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67328b4a0db54dcaaf0909dde5574784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:16Z,use_quota=True,user_id='c7523fce783543b2a428029158e22902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc62567-79b1-40ea-bddb-0db3e12a396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:16 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc62567-79b1-40ea-bddb-0db3e12a396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:16 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6034b7ee-bf88-4eef-8577-7df97d382d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6034b7ee-bf88-4eef-8577-7df97d382d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0bddde-8bdb-40d5-9275-b2873f166e12', 'volume_name': 'volume-ab0bddde-8bdb-40d5-9275-b2873f166e12', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b6729a-4886-4bdb-9c4a-cd5e202928e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b6729a-4886-4bdb-9c4a-cd5e202928e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca91985-fd66-4d63-8a92-b3703bc276d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Volume ab0bddde-8bdb-40d5-9275-b2873f166e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0bddde-8bdb-40d5-9275-b2873f166e12', 'volume_size': 1} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-72c7d39d-e507-465b-bf00-4ca694165837 req-90e3dd95-95ac-4203-97b3-4106a641d928 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:16 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:16 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 is being set with open permissions: ugo+rw Sep 25 16:08:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:16 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 Sep 25 16:08:16 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:17 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7" returned: 0 in 0.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-924113176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0bddde-8bdb-40d5-9275-b2873f166e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67328b4a0db54dcaaf0909dde5574784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:16Z,use_quota=True,user_id='c7523fce783543b2a428029158e22902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Creating volume ab0bddde-8bdb-40d5-9275-b2873f166e12 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:17 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3e5d05a6-d9f9-412b-8674-b65f9dee3ae9 tempest-SnapshotsActionsTest-499662135 None] Create snapshot completed successfully Sep 25 16:08:17 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 1073741824 Sep 25 16:08:17 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:17 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 1073741824" returned: 0 in 0.660s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:17 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 Sep 25 16:08:17 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-quobyte-5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Deleting offline snapshot 5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] snapshot_file for this snap is: volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[17975029-dcab-4483-a327-b1b45fd5e83e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:18 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 Sep 25 16:08:18 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:18 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12" returned: 0 in 0.690s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-72c7d39d-e507-465b-bf00-4ca694165837 req-90e3dd95-95ac-4203-97b3-4106a641d928 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.078s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca91985-fd66-4d63-8a92-b3703bc276d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0bddde-8bdb-40d5-9275-b2873f166e12', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecfaefb-c52d-401f-9f07-d5e668d826d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-72c7d39d-e507-465b-bf00-4ca694165837 req-90e3dd95-95ac-4203-97b3-4106a641d928 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.088s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:18 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Volume volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 (ab0bddde-8bdb-40d5-9275-b2873f166e12): created successfully Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecfaefb-c52d-401f-9f07-d5e668d826d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Flow 'volume_create_manager' (ff0c2745-c770-430f-8622-ae1651f2ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-151e3b6e-7729-49d7-bfb7-748801cab106 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Created volume successfully. Sep 25 16:08:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-72c7d39d-e507-465b-bf00-4ca694165837 req-90e3dd95-95ac-4203-97b3-4106a641d928 tempest-ServerActionsTestOtherA-1750413974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-c7d391d4-fe90-4b2e-9822-105038d66767', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '559eab72-dcb6-46a6-bc76-2433816efe97', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:08:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-72c7d39d-e507-465b-bf00-4ca694165837 req-90e3dd95-95ac-4203-97b3-4106a641d928 tempest-ServerActionsTestOtherA-1750413974 None] attachment_update completed successfully. Sep 25 16:08:19 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7" returned: 0 in 1.119s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff4bfae-2755-4346-baef-d276c4012adf]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:19 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:19 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Creating offline snapshot 376e2a59-0387-4b19-a71c-06d66fcbca80 of volume ab0bddde-8bdb-40d5-9275-b2873f166e12 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e05cea-bb3e-4701-afcd-f9c0103b32af]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:20 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 Sep 25 16:08:20 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:20 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 1.133s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:20 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 Sep 25 16:08:20 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:20 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12" returned: 0 in 0.820s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:20 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 1G Sep 25 16:08:20 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:21 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7" returned: 0 in 1.007s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:21 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7 Sep 25 16:08:21 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:21 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 1G" returned: 0 in 1.035s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:21 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 Sep 25 16:08:21 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:22 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7" returned: 0 in 0.618s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7" released by "_delete_snapshot" :: held 4.117s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" released by "delete_snapshot" :: held 4.167s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:22 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Created reservations ['d5225d90-d6da-4eaf-bb1c-3b3e4db402f7', 'e0ad76dd-685b-4581-816e-072ea3b72187', '561e4e0b-2b1b-4ddb-86b4-299c8541d86a', '6c785835-44ef-4f85-a3c2-7eece3858949'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Delete snapshot completed successfully. Sep 25 16:08:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-846b1368-e445-47ed-801c-06be42f4d804 tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-5a2fbbd4-f7ec-4699-b4e3-64fb87f150e7-delete_snapshot" released by "delete_snapshot" :: held 4.481s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:22 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80" returned: 0 in 0.538s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:22 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 is being set with open permissions: ugo+rw Sep 25 16:08:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:22 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 Sep 25 16:08:22 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:22 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:22 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.info Sep 25 16:08:22 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:23 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.info" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:23 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.info is being set with open permissions: ugo+rw Sep 25 16:08:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:23 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.info Sep 25 16:08:23 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:23 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.info" returned: 0 in 0.521s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.728s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b1b3b190-c6dd-4917-9f14-d149dff0a055 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Create snapshot completed successfully Sep 25 16:08:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Creating offline snapshot 6f97a3f5-6646-422d-b6c0-06f9042357f1 of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:08:24 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5641c23-babd-4d9b-990f-bc1060d43434]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:24 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:24 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:25 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.746s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:25 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 1G Sep 25 16:08:25 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Acquiring lock "cinder-376e2a59-0387-4b19-a71c-06d66fcbca80-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-376e2a59-0387-4b19-a71c-06d66fcbca80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Acquiring lock "cinder-quobyte-ab0bddde-8bdb-40d5-9275-b2873f166e12" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-quobyte-ab0bddde-8bdb-40d5-9275-b2873f166e12" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Acquiring lock "cinder-quobyte-376e2a59-0387-4b19-a71c-06d66fcbca80" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-quobyte-376e2a59-0387-4b19-a71c-06d66fcbca80" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Deleting offline snapshot 376e2a59-0387-4b19-a71c-06d66fcbca80 of volume ab0bddde-8bdb-40d5-9275-b2873f166e12 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] snapshot_file for this snap is: volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6de3db0-5e14-4c66-9fb1-0c504df8fde1]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:25 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 Sep 25 16:08:25 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-85df0724-c24d-4bf3-85a5-798eff133fb3 req-8f6c952d-815a-4ef7-ab47-cf26e6e34d83 tempest-ServerActionsTestOtherA-1750413974 None] Terminate volume connection completed successfully. Sep 25 16:08:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-85df0724-c24d-4bf3-85a5-798eff133fb3 req-8f6c952d-815a-4ef7-ab47-cf26e6e34d83 tempest-ServerActionsTestOtherA-1750413974 None] Deleting attachment 559eab72-dcb6-46a6-bc76-2433816efe97. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:08:26 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 1G" returned: 0 in 0.962s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:26 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 Sep 25 16:08:26 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80" returned: 0 in 1.087s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0bddde-8bdb-40d5-9275-b2873f166e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:26 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b0dd43-25b2-4e64-9504-fb0688de956d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:26 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1" returned: 0 in 0.810s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:26 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 is being set with open permissions: ugo+rw Sep 25 16:08:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:26 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 Sep 25 16:08:26 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 Sep 25 16:08:26 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:26 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:27 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1" returned: 0 in 0.458s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:27 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12" returned: 0 in 0.709s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-85df0724-c24d-4bf3-85a5-798eff133fb3 req-76b05eda-8d58-4096-8b7a-15e0c9dec588 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:27 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 Sep 25 16:08:27 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.346s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-85df0724-c24d-4bf3-85a5-798eff133fb3 req-76b05eda-8d58-4096-8b7a-15e0c9dec588 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.065s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-85df0724-c24d-4bf3-85a5-798eff133fb3 req-76b05eda-8d58-4096-8b7a-15e0c9dec588 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.057s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b4296f84-ce49-446a-9010-aa411268c4db tempest-SnapshotsActionsTest-499662135 None] Create snapshot completed successfully Sep 25 16:08:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-85df0724-c24d-4bf3-85a5-798eff133fb3 req-76b05eda-8d58-4096-8b7a-15e0c9dec588 tempest-ServerActionsTestOtherA-1750413974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-c7d391d4-fe90-4b2e-9822-105038d66767', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e4fdc75-628a-4204-944c-e69475f23cf2', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:08:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-85df0724-c24d-4bf3-85a5-798eff133fb3 req-76b05eda-8d58-4096-8b7a-15e0c9dec588 tempest-ServerActionsTestOtherA-1750413974 None] attachment_update completed successfully. Sep 25 16:08:28 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80" returned: 0 in 0.728s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:28 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80 Sep 25 16:08:28 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:28 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12.376e2a59-0387-4b19-a71c-06d66fcbca80" returned: 0 in 0.317s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-quobyte-376e2a59-0387-4b19-a71c-06d66fcbca80" released by "_delete_snapshot" :: held 3.052s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-quobyte-ab0bddde-8bdb-40d5-9275-b2873f166e12" released by "delete_snapshot" :: held 3.089s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-6f97a3f5-6646-422d-b6c0-06f9042357f1-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-6f97a3f5-6646-422d-b6c0-06f9042357f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Acquiring lock "cinder-quobyte-6f97a3f5-6646-422d-b6c0-06f9042357f1" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-6f97a3f5-6646-422d-b6c0-06f9042357f1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Deleting offline snapshot 6f97a3f5-6646-422d-b6c0-06f9042357f1 of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] snapshot_file for this snap is: volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Created reservations ['ecdede2b-a40b-4e28-a5e8-0516bb6e95e0', 'bd6dff18-2f7f-4ab2-a5a0-d0bb71901b8c', 'e89d5c3b-9164-467f-9567-2e16e81c3483', '4c930f98-01a1-4abb-bca6-ddda3ea4703c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc086659-fccb-4502-b1a4-b1b2b60067dc]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Delete snapshot completed successfully. Sep 25 16:08:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b835b2ff-b60b-41f2-83aa-20aba39ba7a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-376e2a59-0387-4b19-a71c-06d66fcbca80-delete_snapshot" released by "delete_snapshot" :: held 3.423s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:28 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 Sep 25 16:08:28 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:29 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1" returned: 0 in 0.501s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:29 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1446004-f113-40a2-b43b-29888f96dc7f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:29 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:29 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Acquiring lock "cinder-ab0bddde-8bdb-40d5-9275-b2873f166e12-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-ab0bddde-8bdb-40d5-9275-b2873f166e12-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:30 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.961s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:30 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 Sep 25 16:08:30 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Acquiring lock "cinder-quobyte-ab0bddde-8bdb-40d5-9275-b2873f166e12" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-quobyte-ab0bddde-8bdb-40d5-9275-b2873f166e12" acquired by "delete_volume" :: waited 0.049s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ff9200-1e0c-47e1-aa17-9c1de430eefe]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:30 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 Sep 25 16:08:30 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Flow 'volume_create_manager' (8d9e5bf0-7f48-4de9-a1b2-db553e1bcc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad315929-9039-40c6-ac92-51722a91d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1" returned: 0 in 0.941s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad315929-9039-40c6-ac92-51722a91d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-94634623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46542c5a-81e7-40c8-8635-bd6334298020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0f05ba65b64c07ac23a39bdfed4608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:31Z,use_quota=True,user_id='69fb88b686244d4cb0fa9addd4d5c7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4680308e-839e-4fcc-8a6e-c9c454ceda2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4680308e-839e-4fcc-8a6e-c9c454ceda2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1 Sep 25 16:08:31 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96677753-a6cd-4f35-8f5b-48027289f883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96677753-a6cd-4f35-8f5b-48027289f883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46542c5a-81e7-40c8-8635-bd6334298020', 'volume_name': 'volume-46542c5a-81e7-40c8-8635-bd6334298020', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e361ea4e-6566-4108-a16c-81227d53a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e361ea4e-6566-4108-a16c-81227d53a54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c926c33e-4af2-432a-90f1-9d9901e8814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Volume 46542c5a-81e7-40c8-8635-bd6334298020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46542c5a-81e7-40c8-8635-bd6334298020', 'volume_size': 1} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-94634623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46542c5a-81e7-40c8-8635-bd6334298020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0f05ba65b64c07ac23a39bdfed4608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:31Z,use_quota=True,user_id='69fb88b686244d4cb0fa9addd4d5c7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Creating volume 46542c5a-81e7-40c8-8635-bd6334298020 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:31 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:31 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020 1073741824 Sep 25 16:08:31 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:31 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12" returned: 0 in 0.907s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:31 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12 Sep 25 16:08:31 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:31 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.6f97a3f5-6646-422d-b6c0-06f9042357f1" returned: 0 in 0.492s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-6f97a3f5-6646-422d-b6c0-06f9042357f1" released by "_delete_snapshot" :: held 3.160s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" released by "delete_snapshot" :: held 3.197s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Created reservations ['0246f8bb-a6ca-41ca-9c69-e826aed2bdc3', '22eed086-c009-48d9-a3cc-3a36277a3f35', '190493a5-fa07-4a8c-b118-d7a291d7cf27', '1bb4f1e9-3f73-4755-86b1-d6d98d8a8752'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:32 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab0bddde-8bdb-40d5-9275-b2873f166e12" returned: 0 in 0.553s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-quobyte-ab0bddde-8bdb-40d5-9275-b2873f166e12" released by "delete_volume" :: held 1.593s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Delete snapshot completed successfully. Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7073367e-f9e0-4b0f-bb71-f554e4d7acae tempest-SnapshotsActionsTest-847242556 None] Lock "cinder-6f97a3f5-6646-422d-b6c0-06f9042357f1-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:32 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Created reservations ['8ae5c015-5a7c-48d6-a65a-6ad520a8ebc2', '6deae95a-91cd-4696-b1c8-ee00f6e14e91', 'b02bbf4c-5a5d-410a-bbbc-a9f9230790bb', '1d954452-c125-4020-9394-ac9502fc5972'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020 1073741824" returned: 0 in 0.810s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:32 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020 Sep 25 16:08:32 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:32 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:08:32 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:32 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:32 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Deleted volume successfully. Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c926c33e-4af2-432a-90f1-9d9901e8814f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46542c5a-81e7-40c8-8635-bd6334298020', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fb2264-ea62-43c5-8351-70efee5e1d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Volume volume-46542c5a-81e7-40c8-8635-bd6334298020 (46542c5a-81e7-40c8-8635-bd6334298020): created successfully Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fb2264-ea62-43c5-8351-70efee5e1d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Flow 'volume_create_manager' (8d9e5bf0-7f48-4de9-a1b2-db553e1bcc3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5be7d1cf-13ff-45ba-99aa-6d2b5992d4b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-323528723 None] Lock "cinder-ab0bddde-8bdb-40d5-9275-b2873f166e12-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3e9872de-37db-4d63-97db-9dd6752a22b4 tempest-ServersNegativeTestJSON-404151110 None] Created volume successfully. Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "cinder-b7034b33-e201-48bd-bcdc-0295b8862139-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-b7034b33-e201-48bd-bcdc-0295b8862139-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "cinder-quobyte-b7034b33-e201-48bd-bcdc-0295b8862139" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-quobyte-b7034b33-e201-48bd-bcdc-0295b8862139" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Deleting offline snapshot b7034b33-e201-48bd-bcdc-0295b8862139 of volume 3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] snapshot_file for this snap is: volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[590d2e55-30fb-4346-abc0-c10e21179d68]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:34 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:34 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:34 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 1.015s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a5faea-31d4-472d-8320-406574d0af87]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:35 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b Sep 25 16:08:35 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:35 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b" returned: 0 in 0.777s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:35 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:35 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Flow 'volume_create_manager' (93b58175-8e6d-4bdc-993a-0778b52c7b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b791321f-d743-43bc-8807-08daf47109bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b791321f-d743-43bc-8807-08daf47109bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-93565809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58809211-2ac7-4179-8d27-462652d19bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0f05ba65b64c07ac23a39bdfed4608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:36Z,use_quota=True,user_id='69fb88b686244d4cb0fa9addd4d5c7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e3c825-f1d1-4239-bfa0-56fbfa834ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e3c825-f1d1-4239-bfa0-56fbfa834ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38a7de6-f13c-48f3-a73d-a871a26135fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38a7de6-f13c-48f3-a73d-a871a26135fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58809211-2ac7-4179-8d27-462652d19bcd', 'volume_name': 'volume-58809211-2ac7-4179-8d27-462652d19bcd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbf3ffb-30da-4b28-b5e4-ce5b98d19cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbf3ffb-30da-4b28-b5e4-ce5b98d19cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2342cbd8-9122-4fc8-a37b-da946b8edb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Volume 58809211-2ac7-4179-8d27-462652d19bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58809211-2ac7-4179-8d27-462652d19bcd', 'volume_size': 1} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-93565809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58809211-2ac7-4179-8d27-462652d19bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0f05ba65b64c07ac23a39bdfed4608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:36Z,use_quota=True,user_id='69fb88b686244d4cb0fa9addd4d5c7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Creating volume 58809211-2ac7-4179-8d27-462652d19bcd {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:36 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd 1073741824 Sep 25 16:08:36 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:36 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.797s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:36 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139 Sep 25 16:08:36 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:37 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd 1073741824" returned: 0 in 0.887s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:37 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b.b7034b33-e201-48bd-bcdc-0295b8862139" returned: 0 in 0.532s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-quobyte-b7034b33-e201-48bd-bcdc-0295b8862139" released by "_delete_snapshot" :: held 3.400s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" released by "delete_snapshot" :: held 3.431s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:37 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd Sep 25 16:08:37 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Created reservations ['40f739ed-21a4-4c79-90db-e9bc1e702534', '4490ff8d-5339-4f7e-aa27-9896ad673def', '65bf272a-e5de-4117-b43c-f51676280fdb', 'dfdbeab7-a3b3-4275-ac08-3a326d4194c3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Delete snapshot completed successfully. Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c927f1d7-cd5f-4b87-bb96-c2b107504762 tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-b7034b33-e201-48bd-bcdc-0295b8862139-delete_snapshot" released by "delete_snapshot" :: held 3.766s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:37 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd" returned: 0 in 0.453s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2342cbd8-9122-4fc8-a37b-da946b8edb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58809211-2ac7-4179-8d27-462652d19bcd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b4424b-2c85-4747-bcef-effcfb09c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Volume volume-58809211-2ac7-4179-8d27-462652d19bcd (58809211-2ac7-4179-8d27-462652d19bcd): created successfully Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b4424b-2c85-4747-bcef-effcfb09c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Flow 'volume_create_manager' (93b58175-8e6d-4bdc-993a-0778b52c7b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-71b4b2da-bdc3-4efa-a7d7-8c5fc0c2d2d7 tempest-ServersNegativeTestJSON-404151110 None] Created volume successfully. Sep 25 16:08:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "cinder-3900a31a-a07e-4a4b-80a7-6edfc868f44b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-3900a31a-a07e-4a4b-80a7-6edfc868f44b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" acquired by "delete_volume" :: waited 0.042s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a477959-a28e-4dd4-a30e-613ec9228459]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:38 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b Sep 25 16:08:38 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "cinder-58809211-2ac7-4179-8d27-462652d19bcd-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Lock "cinder-58809211-2ac7-4179-8d27-462652d19bcd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "cinder-quobyte-58809211-2ac7-4179-8d27-462652d19bcd" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Lock "cinder-quobyte-58809211-2ac7-4179-8d27-462652d19bcd" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e01c1b-7182-4826-ba26-9652ec624a9d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:39 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b" returned: 0 in 0.646s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:39 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd Sep 25 16:08:39 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b Sep 25 16:08:39 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:39 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:39 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3900a31a-a07e-4a4b-80a7-6edfc868f44b" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-quobyte-3900a31a-a07e-4a4b-80a7-6edfc868f44b" released by "delete_volume" :: held 1.191s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:39 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd" returned: 0 in 0.639s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Created reservations ['87faabcd-7468-4f58-ac2a-2ebbf697591e', '88663729-9f63-4c87-bced-b4b86b85ef3d', '475dc767-565f-4f1a-b2cb-ad8798206afa', 'fa24ee49-dd1d-41de-8227-e12f18a909aa'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:39 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd Sep 25 16:08:39 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:40 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:08:40 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:40 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58809211-2ac7-4179-8d27-462652d19bcd" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Lock "cinder-quobyte-58809211-2ac7-4179-8d27-462652d19bcd" released by "delete_volume" :: held 1.126s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Created reservations ['5a890778-5d06-4f8c-9b72-1ff3a5155ec6', 'd4449ac0-5dcd-4805-8052-3453f66c2f1c', '33bbaa6d-9f58-44b4-a2a8-0c4df43c17bb', '0a8baa3d-1c84-46ad-9b55-a65ffda05815'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:40 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Deleted volume successfully. Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9a23407c-062e-4fb3-b93d-2f4bc1393cda tempest-SnapshotsActionsTest-499662135 None] Lock "cinder-3900a31a-a07e-4a4b-80a7-6edfc868f44b-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:40 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:08:40 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:40 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.397s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Deleted volume successfully. Sep 25 16:08:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9309fe5-ba11-44c6-8f17-407aa9e7a888 tempest-ServersNegativeTestJSON-404151110 None] Lock "cinder-58809211-2ac7-4179-8d27-462652d19bcd-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "cinder-46542c5a-81e7-40c8-8635-bd6334298020-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Lock "cinder-46542c5a-81e7-40c8-8635-bd6334298020-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "cinder-quobyte-46542c5a-81e7-40c8-8635-bd6334298020" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Lock "cinder-quobyte-46542c5a-81e7-40c8-8635-bd6334298020" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:41 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0262337-5144-4338-9df2-c9c41c177d7c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:41 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020 Sep 25 16:08:41 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:42 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020" returned: 0 in 0.564s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:42 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020 Sep 25 16:08:42 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:42 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46542c5a-81e7-40c8-8635-bd6334298020" returned: 0 in 0.377s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Lock "cinder-quobyte-46542c5a-81e7-40c8-8635-bd6334298020" released by "delete_volume" :: held 1.014s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Created reservations ['7a477416-77f1-4fd1-96ac-a7bcb59cf793', 'f7851f50-8ba2-456a-918e-1c273b75aaf5', '87f86c64-5c72-43f3-b63e-54b1725c5901', '88629c3b-73ef-424d-85dc-82c5d884fe18'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:42 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:08:42 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:43 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:43 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Deleted volume successfully. Sep 25 16:08:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d618b9a3-19f5-442e-8d4f-45976f938d55 tempest-ServersNegativeTestJSON-404151110 None] Lock "cinder-46542c5a-81e7-40c8-8635-bd6334298020-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Flow 'volume_create_manager' (82a62b6f-883e-4c58-81ba-81401846525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237cf83b-8cf3-4cc5-b44f-4db0caf323a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237cf83b-8cf3-4cc5-b44f-4db0caf323a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1668624715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d01e02f301449c795cf2933d7b02bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:44Z,use_quota=True,user_id='c82ff2faa7724ce5b196cb7890092336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(153ee4b6-72ec-43d4-a9a0-849f72aa5b72),volume_type_id=153ee4b6-72ec-43d4-a9a0-849f72aa5b72)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4607df6-02c0-4efb-a5ec-7d815e0b8a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4607df6-02c0-4efb-a5ec-7d815e0b8a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3758587-2e4c-4a9e-a53f-7fe08d7191ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3758587-2e4c-4a9e-a53f-7fe08d7191ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd', 'volume_name': 'volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edae5872-bc94-4a8e-87ae-dda79704ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edae5872-bc94-4a8e-87ae-dda79704ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ee216-3cd6-4669-8089-67294bd26319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Volume 6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd', 'volume_size': 1} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1668624715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d01e02f301449c795cf2933d7b02bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:44Z,use_quota=True,user_id='c82ff2faa7724ce5b196cb7890092336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(153ee4b6-72ec-43d4-a9a0-849f72aa5b72),volume_type_id=153ee4b6-72ec-43d4-a9a0-849f72aa5b72)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Creating volume 6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:44 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:08:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:44 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd 1073741824 Sep 25 16:08:44 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:45 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd 1073741824" returned: 0 in 1.159s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:45 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd Sep 25 16:08:45 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:46 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd" returned: 0 in 0.785s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ee216-3cd6-4669-8089-67294bd26319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a345a5-3d5b-410e-8d44-7997bc27fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Volume volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd (6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd): created successfully Sep 25 16:08:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a345a5-3d5b-410e-8d44-7997bc27fac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Flow 'volume_create_manager' (82a62b6f-883e-4c58-81ba-81401846525f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fe9fe72b-14ec-4983-bfca-a4c68778d866 tempest-VolumeTypesAccessTest-1555997682 None] Created volume successfully. Sep 25 16:08:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Acquiring lock "cinder-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Lock "cinder-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Acquiring lock "cinder-quobyte-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Lock "cinder-quobyte-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5f8b5b-9fda-476b-9828-81831d82120f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:48 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd Sep 25 16:08:48 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:48 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd" returned: 0 in 0.580s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:48 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd Sep 25 16:08:48 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:49 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Lock "cinder-quobyte-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd" released by "delete_volume" :: held 1.090s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:49 devstack cinder-volume[87314]: WARNING cinder.quota [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-993655233 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-993655233, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:08:49 devstack cinder-volume[87314]: WARNING cinder.quota [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-993655233 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-993655233, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Created reservations ['76df0c89-f983-4b3b-9ce5-7f815c7ece7f', '8908e618-338f-42c3-b7f5-0f36c8ec6678', '65ad7a45-81f5-4dae-869c-196e595b6e48', 'fe6d766f-e147-45d7-b2a0-41feaf3d512c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:49 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:08:49 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:49 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Deleted volume successfully. Sep 25 16:08:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-defaaa44-6253-437c-b17e-7897f837c11c tempest-VolumeTypesAccessTest-1555997682 None] Lock "cinder-6e3e6ef7-57c2-48cb-a633-0d37d6ea88bd-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:58 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:08:58 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:58 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 8 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:08:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:08:59 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=92,cinder:DELETE=7,cinder:UPDATE=104,cinder:INSERT=26 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:09:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=95,cinder:UPDATE=98,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:09:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-65588e53-04e6-4be8-bd10-ccd2010c09a2 req-07bc20b3-30b1-439a-bd7f-7ad62100c35c tempest-ServerActionsTestOtherA-1750413974 None] Terminate volume connection completed successfully. Sep 25 16:09:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-65588e53-04e6-4be8-bd10-ccd2010c09a2 req-07bc20b3-30b1-439a-bd7f-7ad62100c35c tempest-ServerActionsTestOtherA-1750413974 None] Deleting attachment 2e4fdc75-628a-4204-944c-e69475f23cf2. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:09:11 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Flow 'volume_create_manager' (bc7ef896-95a4-4b7b-9a29-1b18915ba82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5d6910-372c-4d49-806e-99dfe0db1aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5d6910-372c-4d49-806e-99dfe0db1aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1481072320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef126817-deee-4c07-a185-bd38cf3961ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27544bc69ec043ffa66a3935ae0e8acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:11Z,use_quota=True,user_id='75ca6bfdae0748e1bc24a76518118798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bd0385-316b-4bfe-9e7e-9f8a69fc20c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bd0385-316b-4bfe-9e7e-9f8a69fc20c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e211707-17bc-48d6-843e-29d69cd9b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:11 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:09:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e211707-17bc-48d6-843e-29d69cd9b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef126817-deee-4c07-a185-bd38cf3961ce', 'volume_name': 'volume-ef126817-deee-4c07-a185-bd38cf3961ce', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c43b1d4-acb4-4dee-9d97-e28cea3519c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c43b1d4-acb4-4dee-9d97-e28cea3519c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509ef771-ca64-494f-bf01-b27f02d93dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Volume ef126817-deee-4c07-a185-bd38cf3961ce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef126817-deee-4c07-a185-bd38cf3961ce', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:09:12 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Trying to clone ef126817-deee-4c07-a185-bd38cf3961ce from image 0d17311a-0d04-4242-8696-17a222efd8fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:09:13 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:09:13 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:09:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[991bd92e-18ff-4a0e-b36b-57780bd6208f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:13 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD Sep 25 16:09:13 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:13 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:13 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa is fetched for user 75ca6bfdae0748e1bc24a76518118798. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:09:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[594130f9-3f07-41cf-bb25-26dfed5ea481]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:14 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD Sep 25 16:09:14 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:14 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1481072320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef126817-deee-4c07-a185-bd38cf3961ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27544bc69ec043ffa66a3935ae0e8acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:11Z,use_quota=True,user_id='75ca6bfdae0748e1bc24a76518118798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Creating volume ef126817-deee-4c07-a185-bd38cf3961ce {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:14 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:09:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:14 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce 1073741824 Sep 25 16:09:14 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:15 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce 1073741824" returned: 0 in 0.863s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:15 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce Sep 25 16:09:15 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:15 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Attempting download of 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume ef126817-deee-4c07-a185-bd38cf3961ce. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:09:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fee3db-a67c-43e0-b7d5-c5e97272306a]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_hnj4kbnw {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:16 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_hnj4kbnw Sep 25 16:09:16 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:16 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_hnj4kbnw" returned: 0 in 0.490s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_hnj4kbnw {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:16 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_hnj4kbnw Sep 25 16:09:16 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:17 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_hnj4kbnw" returned: 1 in 0.467s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_hnj4kbnw' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:09:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3f1836-c653-476a-a861-0c8575833929]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:17 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD Sep 25 16:09:17 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:17 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:17 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87314) copy_or_move_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1011}} Sep 25 16:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce iflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:17 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce iflag=direct Sep 25 16:09:17 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:17 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce iflag=direct" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:17 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce oflag=direct Sep 25 16:09:17 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:18 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce oflag=direct" returned: 0 in 0.402s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:18 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:09:18 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:19 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 0.986s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:19 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_0vr53g0adevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce, size 21.00 MB, duration 1.00 sec {{(pid=87314) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:09:19 devstack cinder-volume[87314]: INFO cinder.volume.volume_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Volume copy 21.00 MB at 21.00 MB/s Sep 25 16:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:19 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce 1G Sep 25 16:09:19 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:19 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce 1G" returned: 0 in 0.580s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:19 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Downloaded image 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume ef126817-deee-4c07-a185-bd38cf3961ce successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:09:19 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa for user 75ca6bfdae0748e1bc24a76518118798 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:09:19 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Marking volume ef126817-deee-4c07-a185-bd38cf3961ce as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:09:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Copying metadata from image 0d17311a-0d04-4242-8696-17a222efd8fa to ef126817-deee-4c07-a185-bd38cf3961ce. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:09:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Creating volume glance metadata for volume ef126817-deee-4c07-a185-bd38cf3961ce backed by image 0d17311a-0d04-4242-8696-17a222efd8fa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509ef771-ca64-494f-bf01-b27f02d93dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef126817-deee-4c07-a185-bd38cf3961ce', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1e0086-bc6a-445b-8442-7ff01a89a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Volume volume-ef126817-deee-4c07-a185-bd38cf3961ce (ef126817-deee-4c07-a185-bd38cf3961ce): created successfully Sep 25 16:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1e0086-bc6a-445b-8442-7ff01a89a92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Flow 'volume_create_manager' (bc7ef896-95a4-4b7b-9a29-1b18915ba82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-149bd481-8da3-4ea0-80dd-03fa6cda7551 tempest-ServerActionsTestOtherA-1750413974 None] Created volume successfully. Sep 25 16:09:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-df27827e-b14c-4902-b881-457182e17ca6 req-a5b36cd5-4350-48ad-ab0c-b3c7b4efe398 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-df27827e-b14c-4902-b881-457182e17ca6 req-a5b36cd5-4350-48ad-ab0c-b3c7b4efe398 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-df27827e-b14c-4902-b881-457182e17ca6 req-a5b36cd5-4350-48ad-ab0c-b3c7b4efe398 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-df27827e-b14c-4902-b881-457182e17ca6 req-a5b36cd5-4350-48ad-ab0c-b3c7b4efe398 tempest-ServerActionsTestOtherA-1750413974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-ef126817-deee-4c07-a185-bd38cf3961ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed4b1938-ed19-4be4-a000-04b879cf1006', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:09:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-df27827e-b14c-4902-b881-457182e17ca6 req-a5b36cd5-4350-48ad-ab0c-b3c7b4efe398 tempest-ServerActionsTestOtherA-1750413974 None] attachment_update completed successfully. Sep 25 16:09:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-83d26b36-471f-49f3-ac6e-9d918ea88642 tempest-GroupsV320Test-1665487911 None] Group tempest-GroupsV320Test-Group-1509572408: creating Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Flow 'volume_create_manager' (7bb10905-ffdd-4ef6-827d-20e609dc1899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bf2c54-73b8-47fc-af06-e01582d0d45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bf2c54-73b8-47fc-af06-e01582d0d45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1468385644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2247427-08ec-4ce1-bcd7-5c42035d2034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16776fda6ca4baebb78fa1f2e1ff0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:28Z,use_quota=True,user_id='df382854f9bf4c3e9b9d1e469bd799ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6a2bc3-f186-43f1-a847-3e3a582a0c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6a2bc3-f186-43f1-a847-3e3a582a0c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79aa551e-1aea-43eb-893b-4b3dcabf8181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79aa551e-1aea-43eb-893b-4b3dcabf8181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2247427-08ec-4ce1-bcd7-5c42035d2034', 'volume_name': 'volume-c2247427-08ec-4ce1-bcd7-5c42035d2034', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c6d957-7c3d-431e-b8aa-2aff617d1995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c6d957-7c3d-431e-b8aa-2aff617d1995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42802aaf-0a34-4611-b4e1-c2ecb3a5edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Volume c2247427-08ec-4ce1-bcd7-5c42035d2034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2247427-08ec-4ce1-bcd7-5c42035d2034', 'volume_size': 1} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1468385644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2247427-08ec-4ce1-bcd7-5c42035d2034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16776fda6ca4baebb78fa1f2e1ff0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:28Z,use_quota=True,user_id='df382854f9bf4c3e9b9d1e469bd799ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Creating volume c2247427-08ec-4ce1-bcd7-5c42035d2034 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:28 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-83d26b36-471f-49f3-ac6e-9d918ea88642 tempest-GroupsV320Test-1665487911 None] Group tempest-GroupsV320Test-Group-1509572408: created successfully Sep 25 16:09:28 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 1073741824 Sep 25 16:09:28 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-83d26b36-471f-49f3-ac6e-9d918ea88642 tempest-GroupsV320Test-1665487911 None] Create group completed successfully. Sep 25 16:09:28 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 1073741824" returned: 0 in 0.736s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:29 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 Sep 25 16:09:29 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:29 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034" returned: 0 in 0.387s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42802aaf-0a34-4611-b4e1-c2ecb3a5edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2247427-08ec-4ce1-bcd7-5c42035d2034', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374fa269-9cdd-459c-9df9-d2f07f0a673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Volume volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 (c2247427-08ec-4ce1-bcd7-5c42035d2034): created successfully Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374fa269-9cdd-459c-9df9-d2f07f0a673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Flow 'volume_create_manager' (7bb10905-ffdd-4ef6-827d-20e609dc1899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-faf52951-3a32-458a-838f-15432430b336 tempest-SnapshotMetadataTestJSON-806437413 None] Created volume successfully. Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Flow 'volume_create_manager' (13d75220-170a-4192-9929-d4187c5ac8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236e7434-4afb-4b72-bef0-b6e2ec8c19fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236e7434-4afb-4b72-bef0-b6e2ec8c19fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1503750632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240ed083-9faa-4936-a61e-75025aa0d114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dcd3e35c444ca6b694d0a830cd4dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:30Z,use_quota=True,user_id='c764697a3bba48b59821961a35acd342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2b5d43-7a4f-4445-be8f-78a574d1a2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2b5d43-7a4f-4445-be8f-78a574d1a2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f1bd49-2d62-46f2-9ba1-23f177b438dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f1bd49-2d62-46f2-9ba1-23f177b438dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240ed083-9faa-4936-a61e-75025aa0d114', 'volume_name': 'volume-240ed083-9faa-4936-a61e-75025aa0d114', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd2097-cae2-436b-9587-d8396e2d5bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd2097-cae2-436b-9587-d8396e2d5bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a853f64a-d7d7-4ab7-a43c-ffad2ae1d9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Volume 240ed083-9faa-4936-a61e-75025aa0d114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240ed083-9faa-4936-a61e-75025aa0d114', 'volume_size': 1} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1503750632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240ed083-9faa-4936-a61e-75025aa0d114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dcd3e35c444ca6b694d0a830cd4dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:30Z,use_quota=True,user_id='c764697a3bba48b59821961a35acd342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Creating volume 240ed083-9faa-4936-a61e-75025aa0d114 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:29 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:29 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114 1073741824 Sep 25 16:09:29 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] Created reservations ['8bdcb4ad-a077-44a4-88ed-d20d7c36bd26'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:30 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:09:30 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:30 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.669s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:30 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-81d870c8-5917-4961-abd3-1cd224628baa tempest-GroupsV320Test-1665487911 None] Delete group completed successfully. Sep 25 16:09:30 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114 1073741824" returned: 0 in 0.996s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:30 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114 Sep 25 16:09:30 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:31 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114" returned: 0 in 0.489s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.615s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Creating offline snapshot 4d0a63a6-dfb1-4333-b608-b8a00ccbe705 of volume c2247427-08ec-4ce1-bcd7-5c42035d2034 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a853f64a-d7d7-4ab7-a43c-ffad2ae1d9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240ed083-9faa-4936-a61e-75025aa0d114', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6520079-eb33-407e-b4b5-00694c05d8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe41c34d-40f0-4af5-943d-fd1eb2972c00]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Volume volume-240ed083-9faa-4936-a61e-75025aa0d114 (240ed083-9faa-4936-a61e-75025aa0d114): created successfully Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6520079-eb33-407e-b4b5-00694c05d8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Flow 'volume_create_manager' (13d75220-170a-4192-9929-d4187c5ac8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b27678ee-82e6-4b1e-919c-29d1f3cdcf37 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Created volume successfully. Sep 25 16:09:31 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 Sep 25 16:09:31 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:32 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034" returned: 0 in 0.722s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:32 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 1G Sep 25 16:09:32 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:32 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 1G" returned: 0 in 0.615s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:32 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 Sep 25 16:09:32 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:33 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705" returned: 0 in 0.488s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:33 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 is being set with open permissions: ugo+rw Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:33 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 Sep 25 16:09:33 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Acquiring lock "cinder-240ed083-9faa-4936-a61e-75025aa0d114-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:33 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "cinder-240ed083-9faa-4936-a61e-75025aa0d114-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705" returned: 0 in 0.387s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Acquiring lock "cinder-quobyte-240ed083-9faa-4936-a61e-75025aa0d114" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "cinder-quobyte-240ed083-9faa-4936-a61e-75025aa0d114" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:33 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.info Sep 25 16:09:33 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8305b5c-7a54-45ff-b867-1ad8fc41ea9c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:33 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114 Sep 25 16:09:33 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:34 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.info" returned: 0 in 0.411s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:34 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.info is being set with open permissions: ugo+rw Sep 25 16:09:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:34 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.info Sep 25 16:09:34 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:34 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114" returned: 0 in 0.708s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:34 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114 Sep 25 16:09:34 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:34 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.info" returned: 0 in 0.700s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.540s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2572ac10-fd2c-4567-b90f-a3b4e3fc9efa tempest-SnapshotMetadataTestJSON-806437413 None] Create snapshot completed successfully Sep 25 16:09:35 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-240ed083-9faa-4936-a61e-75025aa0d114" returned: 0 in 0.651s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "cinder-quobyte-240ed083-9faa-4936-a61e-75025aa0d114" released by "delete_volume" :: held 1.431s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:35 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Created reservations ['6b567d19-56d9-46e6-be78-56376f1d0d6a', 'ddc69780-22f7-4f01-a4cf-5c820f5a8ab5', '421c81ce-b443-4d22-a185-d73fac0cbc46', '7bc043be-f278-4620-8db0-f1d40618b479'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:35 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:09:35 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:36 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.647s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:36 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Deleted volume successfully. Sep 25 16:09:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3f29848a-1a3d-499f-98c3-a52ec63543d8 tempest-VolumeQuotasNegativeTestJSON-836644840 None] Lock "cinder-240ed083-9faa-4936-a61e-75025aa0d114-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Acquiring lock "cinder-4d0a63a6-dfb1-4333-b608-b8a00ccbe705-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-4d0a63a6-dfb1-4333-b608-b8a00ccbe705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Acquiring lock "cinder-quobyte-c2247427-08ec-4ce1-bcd7-5c42035d2034" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-quobyte-c2247427-08ec-4ce1-bcd7-5c42035d2034" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Acquiring lock "cinder-quobyte-4d0a63a6-dfb1-4333-b608-b8a00ccbe705" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-quobyte-4d0a63a6-dfb1-4333-b608-b8a00ccbe705" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Deleting offline snapshot 4d0a63a6-dfb1-4333-b608-b8a00ccbe705 of volume c2247427-08ec-4ce1-bcd7-5c42035d2034 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:09:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] snapshot_file for this snap is: volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:09:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ee6c19-0d5c-469b-9881-7dbd9d6a86a3]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:37 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 Sep 25 16:09:37 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:37 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705" returned: 0 in 0.829s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2247427-08ec-4ce1-bcd7-5c42035d2034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:09:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2552a5-7bc0-4c77-91ba-6c6d965d4ef5]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:38 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 Sep 25 16:09:38 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:38 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034" returned: 0 in 0.715s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:38 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 Sep 25 16:09:38 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:39 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705" returned: 0 in 0.798s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:39 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705 Sep 25 16:09:39 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:39 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034.4d0a63a6-dfb1-4333-b608-b8a00ccbe705" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-quobyte-4d0a63a6-dfb1-4333-b608-b8a00ccbe705" released by "_delete_snapshot" :: held 3.003s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-quobyte-c2247427-08ec-4ce1-bcd7-5c42035d2034" released by "delete_snapshot" :: held 3.043s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:40 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Created reservations ['0e9ae1d7-22d6-4663-b50a-b0c4f0f2f01a', '04e4a5f4-c532-468c-beac-b7b74d4bdca4', '55068b2c-7042-4426-b2af-4f05958c195b', 'd47ffdbf-4c90-4550-961e-36c2158660d3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Delete snapshot completed successfully. Sep 25 16:09:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc868e84-8dd9-4915-89e7-865eaa726a3f tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-4d0a63a6-dfb1-4333-b608-b8a00ccbe705-delete_snapshot" released by "delete_snapshot" :: held 3.479s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Acquiring lock "cinder-c2247427-08ec-4ce1-bcd7-5c42035d2034-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-c2247427-08ec-4ce1-bcd7-5c42035d2034-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Acquiring lock "cinder-quobyte-c2247427-08ec-4ce1-bcd7-5c42035d2034" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-quobyte-c2247427-08ec-4ce1-bcd7-5c42035d2034" acquired by "delete_volume" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:41 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a97900f-2f5e-4c7d-81fb-8493990f51e1]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:42 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 Sep 25 16:09:42 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:42 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034" returned: 0 in 1.022s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:42 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034 Sep 25 16:09:43 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:43 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c2247427-08ec-4ce1-bcd7-5c42035d2034" returned: 0 in 0.526s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-quobyte-c2247427-08ec-4ce1-bcd7-5c42035d2034" released by "delete_volume" :: held 1.715s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:43 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Created reservations ['f2c9bb2f-6eff-4101-9e50-cac9208c67b9', 'a2616a89-9143-4078-a9db-fe34da85e101', 'b39da895-e9a3-4e0a-929a-fda8da928a88', '02cf6d5b-a7eb-4117-bd03-703beff42681'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:43 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:09:43 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:44 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.836s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:44 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Deleted volume successfully. Sep 25 16:09:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d25c12bd-5298-47cc-8191-a4e94e4350b6 tempest-SnapshotMetadataTestJSON-806437413 None] Lock "cinder-c2247427-08ec-4ce1-bcd7-5c42035d2034-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-69c7e3e0-3b0a-4c46-9c8a-f8a2902650a5 req-43a65393-7c8b-4910-8789-6ffd2497412f tempest-ServerActionsTestOtherA-1750413974 None] Terminate volume connection completed successfully. Sep 25 16:09:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-69c7e3e0-3b0a-4c46-9c8a-f8a2902650a5 req-43a65393-7c8b-4910-8789-6ffd2497412f tempest-ServerActionsTestOtherA-1750413974 None] Deleting attachment ed4b1938-ed19-4be4-a000-04b879cf1006. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-69c7e3e0-3b0a-4c46-9c8a-f8a2902650a5 req-f0bd3913-6015-4b44-bd91-2269b3afbb08 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-69c7e3e0-3b0a-4c46-9c8a-f8a2902650a5 req-f0bd3913-6015-4b44-bd91-2269b3afbb08 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-69c7e3e0-3b0a-4c46-9c8a-f8a2902650a5 req-f0bd3913-6015-4b44-bd91-2269b3afbb08 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Flow 'volume_create_manager' (3a65da56-3649-48af-a1c0-31fadaf5a7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ddb033-0c79-4ceb-8459-d5b671e15c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ddb033-0c79-4ceb-8459-d5b671e15c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1538462755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9c8436-ca64-4f2d-836c-364fdf5b8143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184aa2081f7940cf946ca130c7d39b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:54Z,use_quota=True,user_id='c3952d144f1f44d89514f15ab3d4f8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3165275-9e94-4d7e-bf8b-528aa7dd578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3165275-9e94-4d7e-bf8b-528aa7dd578f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40330c5a-8dfd-48de-b424-08bc8d126f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40330c5a-8dfd-48de-b424-08bc8d126f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9c8436-ca64-4f2d-836c-364fdf5b8143', 'volume_name': 'volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3c775c-51b7-43f9-bab9-5dd9a39e3270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3c775c-51b7-43f9-bab9-5dd9a39e3270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da13a6a-2d9d-4a21-9b23-2c193076dd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:53 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Volume 1b9c8436-ca64-4f2d-836c-364fdf5b8143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143', 'volume_size': 1} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1538462755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9c8436-ca64-4f2d-836c-364fdf5b8143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184aa2081f7940cf946ca130c7d39b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:54Z,use_quota=True,user_id='c3952d144f1f44d89514f15ab3d4f8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Creating volume 1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:53 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:53 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 1073741824 Sep 25 16:09:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-69c7e3e0-3b0a-4c46-9c8a-f8a2902650a5 req-f0bd3913-6015-4b44-bd91-2269b3afbb08 tempest-ServerActionsTestOtherA-1750413974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-ef126817-deee-4c07-a185-bd38cf3961ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4aa08957-49d8-4616-b5de-e19513e88367', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:09:53 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-69c7e3e0-3b0a-4c46-9c8a-f8a2902650a5 req-f0bd3913-6015-4b44-bd91-2269b3afbb08 tempest-ServerActionsTestOtherA-1750413974 None] attachment_update completed successfully. Sep 25 16:09:54 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 1073741824" returned: 0 in 0.896s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:54 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 Sep 25 16:09:54 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:55 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143" returned: 0 in 0.514s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da13a6a-2d9d-4a21-9b23-2c193076dd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea645302-dfae-40c4-9c3e-e4a886cb04f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:55 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Volume volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 (1b9c8436-ca64-4f2d-836c-364fdf5b8143): created successfully Sep 25 16:09:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea645302-dfae-40c4-9c3e-e4a886cb04f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Flow 'volume_create_manager' (3a65da56-3649-48af-a1c0-31fadaf5a7e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-03611310-6c29-498c-95ba-72a274886809 tempest-VolumesDeleteCascade-303881476 None] Created volume successfully. Sep 25 16:09:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Creating offline snapshot d059c120-913d-411f-a132-1b393d7e30a7 of volume 1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:09:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae614cbe-478e-4209-803e-5867a631d1c2]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:56 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 Sep 25 16:09:56 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:57 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143" returned: 0 in 0.859s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:57 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 1G Sep 25 16:09:57 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:57 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 1G" returned: 0 in 0.822s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:58 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 Sep 25 16:09:58 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:58 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7" returned: 0 in 0.491s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:58 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 is being set with open permissions: ugo+rw Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:58 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 Sep 25 16:09:58 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:58 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:09:58 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:58 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7" returned: 0 in 0.469s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:59 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.info Sep 25 16:09:59 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:59 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.580s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:09:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:09:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:09:59 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.info" returned: 0 in 0.565s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:59 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.info is being set with open permissions: ugo+rw Sep 25 16:09:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:59 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.info Sep 25 16:09:59 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:00 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.info" returned: 0 in 0.450s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.905s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=54,cinder:UPDATE=47,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:10:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-42e627da-5362-40eb-9a65-9defaea34bdf tempest-VolumesDeleteCascade-303881476 None] Create snapshot completed successfully Sep 25 16:10:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Creating offline snapshot cbb7d88f-2bc3-4b50-aa61-e410c052b22f of volume 1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:10:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bf2ac6-e3f1-45ff-b1b8-e0a21fa75f1f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:01 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 Sep 25 16:10:01 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:01 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7" returned: 0 in 0.774s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:01 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f 1G Sep 25 16:10:01 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:02 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f 1G" returned: 0 in 0.783s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:02 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f Sep 25 16:10:02 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:03 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f" returned: 0 in 0.633s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:03 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f is being set with open permissions: ugo+rw Sep 25 16:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:03 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f Sep 25 16:10:03 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:03 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f" returned: 0 in 0.430s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:03 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=66,cinder:UPDATE=43,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.889s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-02c70fdb-d792-4868-871d-8a999cdf057c tempest-VolumesDeleteCascade-303881476 None] Create snapshot completed successfully Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-1b9c8436-ca64-4f2d-836c-364fdf5b8143-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-1b9c8436-ca64-4f2d-836c-364fdf5b8143-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Performing cascade delete. {{(pid=87314) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-cbb7d88f-2bc3-4b50-aa61-e410c052b22f-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-cbb7d88f-2bc3-4b50-aa61-e410c052b22f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-1b9c8436-ca64-4f2d-836c-364fdf5b8143" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-1b9c8436-ca64-4f2d-836c-364fdf5b8143" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-cbb7d88f-2bc3-4b50-aa61-e410c052b22f" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-cbb7d88f-2bc3-4b50-aa61-e410c052b22f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Deleting offline snapshot cbb7d88f-2bc3-4b50-aa61-e410c052b22f of volume 1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] snapshot_file for this snap is: volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d196acb-e32b-4d40-9f2e-3ef65b5c7147]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:05 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f Sep 25 16:10:05 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:05 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f" returned: 0 in 1.000s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d290090-1d15-4241-a17b-c0385cf75a79]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:06 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 Sep 25 16:10:06 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:06 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7" returned: 0 in 0.691s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:06 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f Sep 25 16:10:06 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:07 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f" returned: 0 in 0.858s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:07 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f Sep 25 16:10:07 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:08 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.cbb7d88f-2bc3-4b50-aa61-e410c052b22f" returned: 0 in 0.634s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-cbb7d88f-2bc3-4b50-aa61-e410c052b22f" released by "_delete_snapshot" :: held 3.383s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-1b9c8436-ca64-4f2d-836c-364fdf5b8143" released by "delete_snapshot" :: held 3.426s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Created reservations ['47f4b0a1-d0c5-4ea8-8bd1-4e84ea78399c', '51362b4c-a7fa-4500-9893-a6ab07be8a65', '28e60db0-93cd-42c6-a9e0-e1ab2625dbe9', 'e766159b-31e8-4d9c-acc1-29070bdd0531'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Delete snapshot completed successfully. Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-cbb7d88f-2bc3-4b50-aa61-e410c052b22f-delete_snapshot" released by "delete_snapshot" :: held 3.817s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-d059c120-913d-411f-a132-1b393d7e30a7-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-d059c120-913d-411f-a132-1b393d7e30a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-1b9c8436-ca64-4f2d-836c-364fdf5b8143" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-1b9c8436-ca64-4f2d-836c-364fdf5b8143" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-d059c120-913d-411f-a132-1b393d7e30a7" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-d059c120-913d-411f-a132-1b393d7e30a7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Deleting offline snapshot d059c120-913d-411f-a132-1b393d7e30a7 of volume 1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] snapshot_file for this snap is: volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[505283e9-ab09-4c55-9dc7-f12da91d3975]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:08 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 Sep 25 16:10:08 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:09 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7" returned: 0 in 0.640s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e02efb9-9fca-4a8e-b290-4c1988471641]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:09 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 Sep 25 16:10:09 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:10 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143" returned: 0 in 0.688s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:10 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 Sep 25 16:10:10 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:10 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7" returned: 0 in 0.495s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:10 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7 Sep 25 16:10:10 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:10 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143.d059c120-913d-411f-a132-1b393d7e30a7" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-d059c120-913d-411f-a132-1b393d7e30a7" released by "_delete_snapshot" :: held 2.354s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-1b9c8436-ca64-4f2d-836c-364fdf5b8143" released by "delete_snapshot" :: held 2.385s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:11 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Created reservations ['3507b4a6-1241-42b2-9f3d-218ddf5b0064', 'cccb00a6-aee1-4a32-8750-ab6c1e4756a4', 'a60d282d-00c6-419b-899f-489e3c7fc5b0', 'b3c54b73-5914-478e-9035-23e389e80b61'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Delete snapshot completed successfully. Sep 25 16:10:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-d059c120-913d-411f-a132-1b393d7e30a7-delete_snapshot" released by "delete_snapshot" :: held 2.615s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Snapshots deleted, issuing volume delete {{(pid=87314) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 16:10:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-1b9c8436-ca64-4f2d-836c-364fdf5b8143" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-1b9c8436-ca64-4f2d-836c-364fdf5b8143" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b130e-b066-4687-b8c6-defff80fe7b2]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:11 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 Sep 25 16:10:11 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:12 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143" returned: 0 in 0.790s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:12 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143 Sep 25 16:10:12 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:12 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1b9c8436-ca64-4f2d-836c-364fdf5b8143" returned: 0 in 0.533s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-1b9c8436-ca64-4f2d-836c-364fdf5b8143" released by "delete_volume" :: held 1.449s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Created reservations ['a890c79f-400d-476d-90e1-225276fea315', '49137517-32c3-4b06-80ec-d6a245e6588e', '20f24147-7677-4f7d-b66c-bb6f2a9c3392', '5cad7c68-a3cf-4bff-864c-8d3742273d9b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:13 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:13 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:13 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.674s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:13 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Deleted volume successfully. Sep 25 16:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f88f8e89-3816-402b-a854-b283fa8e6c87 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-1b9c8436-ca64-4f2d-836c-364fdf5b8143-delete_volume" released by "delete_volume" :: held 9.279s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Flow 'volume_create_manager' (7de69b97-8364-493d-b4cc-da4e2b6ea4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8fe16e-2e56-422c-8152-619fb7958305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8fe16e-2e56-422c-8152-619fb7958305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-258529746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325da842-02c1-43a4-a539-27c5650ddd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184aa2081f7940cf946ca130c7d39b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:15Z,use_quota=True,user_id='c3952d144f1f44d89514f15ab3d4f8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8248eeaf-d85e-48bf-9ee1-eb4e3647f634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8248eeaf-d85e-48bf-9ee1-eb4e3647f634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4447ec7c-00a6-4267-8611-f7f2ae7ae8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4447ec7c-00a6-4267-8611-f7f2ae7ae8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325da842-02c1-43a4-a539-27c5650ddd29', 'volume_name': 'volume-325da842-02c1-43a4-a539-27c5650ddd29', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbbad9f-62e4-4b40-bceb-f0219a66de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbbad9f-62e4-4b40-bceb-f0219a66de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d89b70d-e3f7-4fdd-889c-afa82fa29f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Volume 325da842-02c1-43a4-a539-27c5650ddd29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325da842-02c1-43a4-a539-27c5650ddd29', 'volume_size': 1} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-258529746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325da842-02c1-43a4-a539-27c5650ddd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184aa2081f7940cf946ca130c7d39b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:15Z,use_quota=True,user_id='c3952d144f1f44d89514f15ab3d4f8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Creating volume 325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:15 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:15 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 1073741824 Sep 25 16:10:15 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:16 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 1073741824" returned: 0 in 0.747s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:16 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 Sep 25 16:10:16 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:16 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29" returned: 0 in 0.501s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d89b70d-e3f7-4fdd-889c-afa82fa29f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325da842-02c1-43a4-a539-27c5650ddd29', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0839415c-d0b5-4697-ae1f-a67cc5913340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Volume volume-325da842-02c1-43a4-a539-27c5650ddd29 (325da842-02c1-43a4-a539-27c5650ddd29): created successfully Sep 25 16:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0839415c-d0b5-4697-ae1f-a67cc5913340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Flow 'volume_create_manager' (7de69b97-8364-493d-b4cc-da4e2b6ea4b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ce2c7f20-17ad-4e83-84bc-2d40ec78264e tempest-VolumesDeleteCascade-303881476 None] Created volume successfully. Sep 25 16:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Creating offline snapshot 38c8a757-0bce-4a50-b5b6-b9bcd8d0eede of volume 325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:10:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca6d9e1-3739-4552-9366-6dc1d757f0cb]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:18 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 Sep 25 16:10:18 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:18 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29" returned: 0 in 0.785s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:18 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede 1G Sep 25 16:10:18 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:19 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede 1G" returned: 0 in 0.706s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-325da842-02c1-43a4-a539-27c5650ddd29 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:19 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-325da842-02c1-43a4-a539-27c5650ddd29 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede Sep 25 16:10:19 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:20 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-325da842-02c1-43a4-a539-27c5650ddd29 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede" returned: 0 in 0.771s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:20 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede is being set with open permissions: ugo+rw Sep 25 16:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:20 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede Sep 25 16:10:20 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:20 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:20 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.info Sep 25 16:10:20 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:21 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.info" returned: 0 in 0.491s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:21 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.info is being set with open permissions: ugo+rw Sep 25 16:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:21 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.info Sep 25 16:10:21 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:21 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.info" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.731s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-06081f29-de6d-4cfe-886a-f6f371c3b95a tempest-VolumesDeleteCascade-303881476 None] Create snapshot completed successfully Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Flow 'volume_create_manager' (5fe5c73e-ef23-4d27-ae2a-395db68f79c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0500b1eb-9d31-4254-9adc-9cdeca523d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0500b1eb-9d31-4254-9adc-9cdeca523d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-373100683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f114a790-fa63-45fd-ad33-04fc0f9c10c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184aa2081f7940cf946ca130c7d39b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38c8a757-0bce-4a50-b5b6-b9bcd8d0eede,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:23Z,use_quota=True,user_id='c3952d144f1f44d89514f15ab3d4f8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecbd366-3a10-4b9c-9cf8-efbc68c58c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecbd366-3a10-4b9c-9cf8-efbc68c58c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c3460f-9e85-4ca7-b9aa-e75d5b5a9591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c3460f-9e85-4ca7-b9aa-e75d5b5a9591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f114a790-fa63-45fd-ad33-04fc0f9c10c9', 'volume_name': 'volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9', 'volume_size': 1, 'snapshot_id': '38c8a757-0bce-4a50-b5b6-b9bcd8d0eede'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29098de1-4965-4f94-b5a0-db64d81cf076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29098de1-4965-4f94-b5a0-db64d81cf076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580e34a4-8c9c-4b86-9b6e-e0ecad7689ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Volume f114a790-fa63-45fd-ad33-04fc0f9c10c9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9', 'volume_size': 1, 'snapshot_id': '38c8a757-0bce-4a50-b5b6-b9bcd8d0eede'} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-38c8a757-0bce-4a50-b5b6-b9bcd8d0eede-f114a790-fa63-45fd-ad33-04fc0f9c10c9" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-38c8a757-0bce-4a50-b5b6-b9bcd8d0eede-f114a790-fa63-45fd-ad33-04fc0f9c10c9" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Creating volume f114a790-fa63-45fd-ad33-04fc0f9c10c9 from snapshot 38c8a757-0bce-4a50-b5b6-b9bcd8d0eede {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-f114a790-fa63-45fd-ad33-04fc0f9c10c9" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-f114a790-fa63-45fd-ad33-04fc0f9c10c9" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] snapshot: 38c8a757-0bce-4a50-b5b6-b9bcd8d0eede, volume: f114a790-fa63-45fd-ad33-04fc0f9c10c9, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e074b0-7030-4dba-bd25-c5b1b0605217]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:23 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede Sep 25 16:10:23 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:23 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede" returned: 0 in 0.659s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-325da842-02c1-43a4-a539-27c5650ddd29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ad75d9-500b-4755-ae07-04a0747bc48f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:24 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 Sep 25 16:10:24 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:24 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29" returned: 0 in 0.519s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:10:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:10:24 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:10:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:24 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 Sep 25 16:10:24 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Flow 'volume_create_manager' (779ea73b-6e62-4d20-8783-eda54e2a26c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baff9a7f-6e23-4eb2-a9a8-610f44010433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baff9a7f-6e23-4eb2-a9a8-610f44010433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2117905090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa42a708-b949-46d6-a626-03e0ef49355c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d5542378274447888fc80d1e6563db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:25Z,use_quota=True,user_id='69c512cf44a0426d8f0ab14c1588c90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc1cb4d-2791-4270-bfb2-fefe5a048838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc1cb4d-2791-4270-bfb2-fefe5a048838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a000ff78-67b6-4330-9752-2390ec40a0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a000ff78-67b6-4330-9752-2390ec40a0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa42a708-b949-46d6-a626-03e0ef49355c', 'volume_name': 'volume-fa42a708-b949-46d6-a626-03e0ef49355c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266742d8-6f89-494e-a4b5-1e2555126320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266742d8-6f89-494e-a4b5-1e2555126320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432c2059-ba00-49fa-a0af-f8975ad8d0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:25 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Volume fa42a708-b949-46d6-a626-03e0ef49355c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa42a708-b949-46d6-a626-03e0ef49355c', 'volume_size': 1} Sep 25 16:10:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:33 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9" returned: 0 in 9.578s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:33 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29, size 1024.00 MB, duration 9.58 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:10:33 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Converted 1024.00 MB image at 106.90 MB/s Sep 25 16:10:33 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 is being set with open permissions: ugo+rw Sep 25 16:10:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:34 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 Sep 25 16:10:34 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:34 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9" returned: 0 in 0.399s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-f114a790-fa63-45fd-ad33-04fc0f9c10c9" released by "_copy_volume_from_snapshot" :: held 11.320s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-38c8a757-0bce-4a50-b5b6-b9bcd8d0eede-f114a790-fa63-45fd-ad33-04fc0f9c10c9" released by "_create_volume_from_snapshot" :: held 11.431s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.455s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.267s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2117905090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa42a708-b949-46d6-a626-03e0ef49355c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d5542378274447888fc80d1e6563db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:25Z,use_quota=True,user_id='69c512cf44a0426d8f0ab14c1588c90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Creating volume fa42a708-b949-46d6-a626-03e0ef49355c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:34 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:34 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c 1073741824 Sep 25 16:10:34 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580e34a4-8c9c-4b86-9b6e-e0ecad7689ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9', 'volume_size': 1, 'snapshot_id': '38c8a757-0bce-4a50-b5b6-b9bcd8d0eede'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae926240-ad2b-4861-bf03-ff98ca1317fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Volume volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 (f114a790-fa63-45fd-ad33-04fc0f9c10c9): created successfully Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae926240-ad2b-4861-bf03-ff98ca1317fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Flow 'volume_create_manager' (5fe5c73e-ef23-4d27-ae2a-395db68f79c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-61ec4b3d-e11b-41af-b048-caccee150d92 tempest-VolumesDeleteCascade-303881476 None] Created volume successfully. Sep 25 16:10:35 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c 1073741824" returned: 0 in 0.659s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:35 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c Sep 25 16:10:35 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:35 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-325da842-02c1-43a4-a539-27c5650ddd29-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c" returned: 0 in 0.374s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432c2059-ba00-49fa-a0af-f8975ad8d0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa42a708-b949-46d6-a626-03e0ef49355c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491c4d35-72c0-425f-8946-b14bb95ee6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-325da842-02c1-43a4-a539-27c5650ddd29-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Volume volume-fa42a708-b949-46d6-a626-03e0ef49355c (fa42a708-b949-46d6-a626-03e0ef49355c): created successfully Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491c4d35-72c0-425f-8946-b14bb95ee6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Flow 'volume_create_manager' (779ea73b-6e62-4d20-8783-eda54e2a26c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Performing cascade delete. {{(pid=87314) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 16:10:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2c6750fd-d4f0-4773-a363-093ba33009c0 tempest-VolumesListAdminTestJSON-412440191 None] Created volume successfully. Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-38c8a757-0bce-4a50-b5b6-b9bcd8d0eede-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-38c8a757-0bce-4a50-b5b6-b9bcd8d0eede-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-325da842-02c1-43a4-a539-27c5650ddd29" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-325da842-02c1-43a4-a539-27c5650ddd29" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-38c8a757-0bce-4a50-b5b6-b9bcd8d0eede" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-38c8a757-0bce-4a50-b5b6-b9bcd8d0eede" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Deleting offline snapshot 38c8a757-0bce-4a50-b5b6-b9bcd8d0eede of volume 325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] snapshot_file for this snap is: volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ca4f5a-1375-48dd-b94c-aacd5181999d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:35 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede Sep 25 16:10:35 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:36 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-325da842-02c1-43a4-a539-27c5650ddd29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d132bd72-1b5b-41c4-97df-2e3f1b993aaa]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:36 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 Sep 25 16:10:36 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:36 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29" returned: 0 in 0.715s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:37 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede Sep 25 16:10:37 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Flow 'volume_create_manager' (5a4af6a6-66b8-40a4-947a-f7911150c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c9263c-baf8-48b3-b3c8-bdebecae6fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c9263c-baf8-48b3-b3c8-bdebecae6fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-533104304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7065aa0f-b59f-4847-86ea-00fb45ec16ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d5542378274447888fc80d1e6563db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:37Z,use_quota=True,user_id='69c512cf44a0426d8f0ab14c1588c90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b8d5ee-db0f-47ab-b037-d55e63cfd04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b8d5ee-db0f-47ab-b037-d55e63cfd04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae1b42c-017b-4121-ad54-88cebb41e712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae1b42c-017b-4121-ad54-88cebb41e712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7065aa0f-b59f-4847-86ea-00fb45ec16ec', 'volume_name': 'volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:37 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4080f913-235e-4d04-9038-4f6e65c4fedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4080f913-235e-4d04-9038-4f6e65c4fedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc998fd-0c25-4baf-afac-825445d5da8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Volume 7065aa0f-b59f-4847-86ea-00fb45ec16ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec', 'volume_size': 1} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-533104304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7065aa0f-b59f-4847-86ea-00fb45ec16ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d5542378274447888fc80d1e6563db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:37Z,use_quota=True,user_id='69c512cf44a0426d8f0ab14c1588c90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Creating volume 7065aa0f-b59f-4847-86ea-00fb45ec16ec {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:37 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede" returned: 0 in 0.595s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:37 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec 1073741824 Sep 25 16:10:37 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:37 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede Sep 25 16:10:37 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:37 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29.38c8a757-0bce-4a50-b5b6-b9bcd8d0eede" returned: 0 in 0.374s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-38c8a757-0bce-4a50-b5b6-b9bcd8d0eede" released by "_delete_snapshot" :: held 2.247s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-325da842-02c1-43a4-a539-27c5650ddd29" released by "delete_snapshot" :: held 2.277s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Created reservations ['79baf08b-3bfe-4236-871d-876c55ddda75', '04f10623-038b-46de-b56c-bf3c9c1bac63', '36408fca-3526-408a-a9ff-cc512be90a7e', 'be6b2029-9b1a-46d9-99fa-e33a0e83d3d0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Delete snapshot completed successfully. Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-38c8a757-0bce-4a50-b5b6-b9bcd8d0eede-delete_snapshot" released by "delete_snapshot" :: held 2.703s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Snapshots deleted, issuing volume delete {{(pid=87314) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-325da842-02c1-43a4-a539-27c5650ddd29" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-325da842-02c1-43a4-a539-27c5650ddd29" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:38 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec 1073741824" returned: 0 in 0.994s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e064aafd-b127-49c1-aceb-699833c17dbc]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:38 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec Sep 25 16:10:38 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:38 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 Sep 25 16:10:38 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:39 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc998fd-0c25-4baf-afac-825445d5da8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbfc659-ed0e-4b34-afb3-caa86a9212a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Volume volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec (7065aa0f-b59f-4847-86ea-00fb45ec16ec): created successfully Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbfc659-ed0e-4b34-afb3-caa86a9212a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Flow 'volume_create_manager' (5a4af6a6-66b8-40a4-947a-f7911150c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:39 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4c09c014-a1d4-4a14-9338-192ce6d07f84 tempest-VolumesListAdminTestJSON-412440191 None] Created volume successfully. Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29" returned: 0 in 0.540s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:39 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29 Sep 25 16:10:39 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:39 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-325da842-02c1-43a4-a539-27c5650ddd29" returned: 0 in 0.285s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-325da842-02c1-43a4-a539-27c5650ddd29" released by "delete_volume" :: held 0.965s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Created reservations ['fb50038d-5a64-45c9-b8fa-91e86518b03e', 'cd0fb2dc-f097-423d-8151-e8e080f82387', 'd57a3fdf-c19e-4bac-a265-680c07f57005', '9f2429f8-769a-415e-831c-ca05ee2bac68'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:39 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:39 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:39 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Deleted volume successfully. Sep 25 16:10:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c6a0cfae-9b80-4e83-8783-c61493f4be11 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-325da842-02c1-43a4-a539-27c5650ddd29-delete_volume" released by "delete_volume" :: held 4.330s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-f114a790-fa63-45fd-ad33-04fc0f9c10c9-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-f114a790-fa63-45fd-ad33-04fc0f9c10c9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Flow 'volume_create_manager' (225379da-fe3b-4503-a58c-3a91a9cb11eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef24b951-7626-4f0f-8c7a-35007bb93b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef24b951-7626-4f0f-8c7a-35007bb93b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-980570746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af50c133-d210-46a8-969a-076dd31a4910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d5542378274447888fc80d1e6563db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:40Z,use_quota=True,user_id='69c512cf44a0426d8f0ab14c1588c90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94acdd2-3b7e-44e9-913e-5dbb691abbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94acdd2-3b7e-44e9-913e-5dbb691abbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7015e64-8771-44bb-aea3-a53a4b9b1389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7015e64-8771-44bb-aea3-a53a4b9b1389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af50c133-d210-46a8-969a-076dd31a4910', 'volume_name': 'volume-af50c133-d210-46a8-969a-076dd31a4910', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2eb449-be5c-427f-a6ef-dcb95132018e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2eb449-be5c-427f-a6ef-dcb95132018e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e5013-9423-4108-bc39-c13d97580982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Volume af50c133-d210-46a8-969a-076dd31a4910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af50c133-d210-46a8-969a-076dd31a4910', 'volume_size': 1} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-980570746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af50c133-d210-46a8-969a-076dd31a4910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d5542378274447888fc80d1e6563db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:40Z,use_quota=True,user_id='69c512cf44a0426d8f0ab14c1588c90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Creating volume af50c133-d210-46a8-969a-076dd31a4910 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:40 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "cinder-quobyte-f114a790-fa63-45fd-ad33-04fc0f9c10c9" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:40 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910 1073741824 Sep 25 16:10:40 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-f114a790-fa63-45fd-ad33-04fc0f9c10c9" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe4937-cef9-4baa-a864-65962440a27a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:40 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 Sep 25 16:10:40 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:41 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910 1073741824" returned: 0 in 0.590s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:41 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9" returned: 0 in 0.530s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:41 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9 Sep 25 16:10:41 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:41 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910 Sep 25 16:10:41 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:41 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:41 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f114a790-fa63-45fd-ad33-04fc0f9c10c9" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e5013-9423-4108-bc39-c13d97580982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af50c133-d210-46a8-969a-076dd31a4910', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb78a948-9f6e-4a8f-9518-48fe7758e16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-quobyte-f114a790-fa63-45fd-ad33-04fc0f9c10c9" released by "delete_volume" :: held 1.061s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Volume volume-af50c133-d210-46a8-969a-076dd31a4910 (af50c133-d210-46a8-969a-076dd31a4910): created successfully Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb78a948-9f6e-4a8f-9518-48fe7758e16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Flow 'volume_create_manager' (225379da-fe3b-4503-a58c-3a91a9cb11eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ff4798f7-b083-4794-8eea-707bd6737f37 tempest-VolumesListAdminTestJSON-412440191 None] Created volume successfully. Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Created reservations ['b46c4bfd-8257-472e-879a-3fec4703f25b', '17a10dc4-07d8-486f-9608-b64b8c7d6db2', '2b8fee67-6cb4-445b-ad9e-524dadd55e07', '3c701906-3df8-4f7e-a190-16ea5a31970b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:41 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:41 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:42 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:42 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Deleted volume successfully. Sep 25 16:10:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c7762a7-f4aa-4af2-8fff-d6cfea3b4b53 tempest-VolumesDeleteCascade-303881476 None] Lock "cinder-f114a790-fa63-45fd-ad33-04fc0f9c10c9-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Flow 'volume_create_manager' (880e6aa8-44f5-4274-bc54-9bfbe5530557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e973938-87cb-41e6-b595-6387a3e1bdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e973938-87cb-41e6-b595-6387a3e1bdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa58e112-2454-440b-ac54-6fb4053f4b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca31ff6f3b2449aba8f145c0cd5294d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:44Z,use_quota=True,user_id='9ccf8ceaba684ee49a3a9e3bdd88f8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73644929-9ac3-4028-b378-8a62cd870921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73644929-9ac3-4028-b378-8a62cd870921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c906e1aa-8890-45a3-9c47-e997aa492e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c906e1aa-8890-45a3-9c47-e997aa492e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa58e112-2454-440b-ac54-6fb4053f4b64', 'volume_name': 'volume-fa58e112-2454-440b-ac54-6fb4053f4b64', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbb31c0-60ad-4c3d-bbfd-58db8d2a6d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbb31c0-60ad-4c3d-bbfd-58db8d2a6d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f294139e-4f6c-4491-881f-e220c498d9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Volume fa58e112-2454-440b-ac54-6fb4053f4b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa58e112-2454-440b-ac54-6fb4053f4b64', 'volume_size': 1} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa58e112-2454-440b-ac54-6fb4053f4b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca31ff6f3b2449aba8f145c0cd5294d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:44Z,use_quota=True,user_id='9ccf8ceaba684ee49a3a9e3bdd88f8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Creating volume fa58e112-2454-440b-ac54-6fb4053f4b64 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:44 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:10:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:44 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64 1073741824 Sep 25 16:10:44 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:45 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64 1073741824" returned: 0 in 0.687s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:45 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64 Sep 25 16:10:45 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:45 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64" returned: 0 in 0.453s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f294139e-4f6c-4491-881f-e220c498d9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa58e112-2454-440b-ac54-6fb4053f4b64', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926caf51-2820-422d-aff5-5d3728ce43f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Volume volume-fa58e112-2454-440b-ac54-6fb4053f4b64 (fa58e112-2454-440b-ac54-6fb4053f4b64): created successfully Sep 25 16:10:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926caf51-2820-422d-aff5-5d3728ce43f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Flow 'volume_create_manager' (880e6aa8-44f5-4274-bc54-9bfbe5530557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-36b1c332-5669-406f-8d98-1c06a6e849b1 tempest-VolumesListAdminTestJSON-1370832314 None] Created volume successfully. Sep 25 16:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Acquiring lock "cinder-fa58e112-2454-440b-ac54-6fb4053f4b64-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Lock "cinder-fa58e112-2454-440b-ac54-6fb4053f4b64-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Acquiring lock "cinder-quobyte-fa58e112-2454-440b-ac54-6fb4053f4b64" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Lock "cinder-quobyte-fa58e112-2454-440b-ac54-6fb4053f4b64" acquired by "delete_volume" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8146ced8-f3f6-4733-8c3c-9328b5bdc478]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "cinder-af50c133-d210-46a8-969a-076dd31a4910-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-af50c133-d210-46a8-969a-076dd31a4910-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "cinder-quobyte-af50c133-d210-46a8-969a-076dd31a4910" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-quobyte-af50c133-d210-46a8-969a-076dd31a4910" acquired by "delete_volume" :: waited 0.040s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:47 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64 Sep 25 16:10:47 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0cc8f7-9994-405e-b3b6-608ecd813b11]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:47 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910 Sep 25 16:10:47 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:47 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910" returned: 0 in 0.690s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:48 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910 Sep 25 16:10:48 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:48 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64" returned: 0 in 1.186s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:48 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64 Sep 25 16:10:48 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:48 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af50c133-d210-46a8-969a-076dd31a4910" returned: 0 in 0.768s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-quobyte-af50c133-d210-46a8-969a-076dd31a4910" released by "delete_volume" :: held 1.563s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:48 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa58e112-2454-440b-ac54-6fb4053f4b64" returned: 0 in 0.729s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:48 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Created reservations ['4efb1e4c-ed20-4f08-a903-6036b4907728', 'bab1b49a-6654-4ac7-becb-d04482d6b2e8', 'a2ef097f-5808-43c0-b855-2cc2e0830688', 'c67f733a-8fcd-49e7-957a-bff66db8ff7a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Lock "cinder-quobyte-fa58e112-2454-440b-ac54-6fb4053f4b64" released by "delete_volume" :: held 2.062s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Created reservations ['e7b0af75-52e0-491b-8568-d9d46bb6e45a', '76174fa5-46b0-4bb9-945f-adc84a5a5b57', 'd6b3f9be-9b9f-4d47-9841-f56232aeab7c', '5a2ae87d-eaa6-4ae6-9ce9-31715b5f0afc'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:49 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:49 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:49 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:49 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "cinder-7065aa0f-b59f-4847-86ea-00fb45ec16ec-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-7065aa0f-b59f-4847-86ea-00fb45ec16ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "cinder-quobyte-7065aa0f-b59f-4847-86ea-00fb45ec16ec" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-quobyte-7065aa0f-b59f-4847-86ea-00fb45ec16ec" acquired by "delete_volume" :: waited 0.045s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcd0e40-0cff-4074-92cc-d7d672ca4461]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:49 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.482s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Deleted volume successfully. Sep 25 16:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a89eff0-191a-4f29-bcea-b8e9bdaa68ab tempest-VolumesListAdminTestJSON-1370832314 None] Lock "cinder-fa58e112-2454-440b-ac54-6fb4053f4b64-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:50 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec Sep 25 16:10:50 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:50 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.815s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:50 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Deleted volume successfully. Sep 25 16:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-076c150e-cec0-43e1-b604-426b693d1411 tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-af50c133-d210-46a8-969a-076dd31a4910-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:50 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec" returned: 0 in 0.797s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:50 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec Sep 25 16:10:50 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:51 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7065aa0f-b59f-4847-86ea-00fb45ec16ec" returned: 0 in 0.613s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-quobyte-7065aa0f-b59f-4847-86ea-00fb45ec16ec" released by "delete_volume" :: held 1.491s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Created reservations ['a4775b76-9b9f-4390-be16-e347389b4449', '1c4ae066-d135-46bf-9fad-fd3d4aa14dec', '8304a525-6b34-4a1f-85ce-c73f10c74b39', 'ce788218-3127-4123-b6c7-5b8ec72d5204'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:51 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:51 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-7e5aecb1-cd59-4caa-9713-f0d3f34daad3 tempest-ServerActionsTestOtherA-1750413974 None] Terminate volume connection completed successfully. Sep 25 16:10:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-7e5aecb1-cd59-4caa-9713-f0d3f34daad3 tempest-ServerActionsTestOtherA-1750413974 None] Deleting attachment 4aa08957-49d8-4616-b5de-e19513e88367. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:10:52 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.689s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:52 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Deleted volume successfully. Sep 25 16:10:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-43e16390-d9b6-46c1-bd64-c44c2b59fda4 tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-7065aa0f-b59f-4847-86ea-00fb45ec16ec-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "cinder-ef126817-deee-4c07-a185-bd38cf3961ce-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Lock "cinder-ef126817-deee-4c07-a185-bd38cf3961ce-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "cinder-fa42a708-b949-46d6-a626-03e0ef49355c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "cinder-quobyte-ef126817-deee-4c07-a185-bd38cf3961ce" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-fa42a708-b949-46d6-a626-03e0ef49355c-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Lock "cinder-quobyte-ef126817-deee-4c07-a185-bd38cf3961ce" acquired by "delete_volume" :: waited 0.077s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "cinder-quobyte-fa42a708-b949-46d6-a626-03e0ef49355c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c95ec44-7d25-4619-9932-351cee41f54f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-quobyte-fa42a708-b949-46d6-a626-03e0ef49355c" acquired by "delete_volume" :: waited 0.097s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Flow 'volume_create_manager' (bd9641af-81ad-4076-b12d-748044402d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7998cb9d-6add-4894-990e-2cde53ec4ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc56438-9ef8-46eb-80fd-cebc757ff355]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7998cb9d-6add-4894-990e-2cde53ec4ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1016984414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92db75cf-cb09-480b-884f-df2b4cb2c1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394cebeef5e1483ab79a4cf8b19f099c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:53Z,use_quota=True,user_id='b06a9040fcf04d7380ae054d9c3ed982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6274aa50-30ef-4162-bd5f-cb82dc49a1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6274aa50-30ef-4162-bd5f-cb82dc49a1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ca572f-5f2a-4389-8775-f35793a1d1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:53 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:10:53 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce Sep 25 16:10:53 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:53 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c Sep 25 16:10:53 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ca572f-5f2a-4389-8775-f35793a1d1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92db75cf-cb09-480b-884f-df2b4cb2c1a8', 'volume_name': 'volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ceea26-d986-497b-a9b4-be5c0ff60185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ceea26-d986-497b-a9b4-be5c0ff60185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492d7839-2934-4385-8fe8-36d0fc5db82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Volume 92db75cf-cb09-480b-884f-df2b4cb2c1a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Trying to clone 92db75cf-cb09-480b-884f-df2b4cb2c1a8 from image 0d17311a-0d04-4242-8696-17a222efd8fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:10:54 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce" returned: 0 in 1.163s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:54 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce Sep 25 16:10:54 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:54 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c" returned: 0 in 1.115s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:54 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c Sep 25 16:10:54 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "cinder-c7d391d4-fe90-4b2e-9822-105038d66767-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Lock "cinder-c7d391d4-fe90-4b2e-9822-105038d66767-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "cinder-quobyte-c7d391d4-fe90-4b2e-9822-105038d66767" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Lock "cinder-quobyte-c7d391d4-fe90-4b2e-9822-105038d66767" acquired by "delete_volume" :: waited 0.044s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ba0be8-5a55-4221-9b7d-d4470dc6f0d9]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:55 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef126817-deee-4c07-a185-bd38cf3961ce" returned: 0 in 0.750s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Lock "cinder-quobyte-ef126817-deee-4c07-a185-bd38cf3961ce" released by "delete_volume" :: held 2.115s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:10:55 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Image download 20.69 MB at 20.62 MB/s Sep 25 16:10:55 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767 Sep 25 16:10:55 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.quota [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Created reservations ['65716e24-1335-472a-bff1-696ef1fa80ea', '7637d682-b454-4802-b8ea-8e4bb18ce9a6', '21650706-8c87-4c6e-af59-eb55a888c6aa', '7650d5c1-34ed-4bb9-821b-35e98c110eb0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:55 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fa42a708-b949-46d6-a626-03e0ef49355c" returned: 0 in 0.869s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e785866-d50d-416d-b1fc-9f869180d328]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-quobyte-fa42a708-b949-46d6-a626-03e0ef49355c" released by "delete_volume" :: held 2.220s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Created reservations ['82965068-542d-4abc-80ee-24d645206180', '2ce6fc1d-67e1-4111-9425-aaf722f80f3a', '68362de2-4666-4322-8ebf-67a766d30a0c', '6813e9e5-e5ba-431f-9b4d-1a258460bc9f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:55 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:55 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:55 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD Sep 25 16:10:55 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:56 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:56 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:56 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767" returned: 0 in 0.964s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:56 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767 Sep 25 16:10:56 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:56 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.626s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.manager [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Deleted volume successfully. Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-ab59cc2a-9ab3-46e3-9f50-be47b7dc97f5 req-fb9aa8f3-6c7f-4be4-80e5-8d6a89b0f211 tempest-ServerActionsTestOtherA-1750413974 None] Lock "cinder-ef126817-deee-4c07-a185-bd38cf3961ce-delete_volume" released by "delete_volume" :: held 3.690s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:56 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa is fetched for user b06a9040fcf04d7380ae054d9c3ed982. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:10:56 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.508s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Deleted volume successfully. Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-89a07b74-20a5-4b70-8e10-6fca0795d20e tempest-VolumesListAdminTestJSON-412440191 None] Lock "cinder-fa42a708-b949-46d6-a626-03e0ef49355c-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e40481-cc90-4aef-9681-b13b982c7bc4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (903e15ca-2b33-46a7-b9f2-588ed73530c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ba574c-3dd6-42d0-8f27-f611523e7b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ba574c-3dd6-42d0-8f27-f611523e7b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-958719339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c059667-85db-462d-abbb-a661f9938978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:57Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e24ca49-f9a2-492d-a099-8b97aa88af47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e24ca49-f9a2-492d-a099-8b97aa88af47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b06322-f020-4300-a9c5-922014df8809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b06322-f020-4300-a9c5-922014df8809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c059667-85db-462d-abbb-a661f9938978', 'volume_name': 'volume-1c059667-85db-462d-abbb-a661f9938978', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:56 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3eceec9-57ff-41cb-8ff8-9e0459697d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3eceec9-57ff-41cb-8ff8-9e0459697d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b394e7ec-ac11-482e-a08b-279e41ed28a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Volume 1c059667-85db-462d-abbb-a661f9938978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c059667-85db-462d-abbb-a661f9938978', 'volume_size': 1} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-958719339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c059667-85db-462d-abbb-a661f9938978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:57Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Creating volume 1c059667-85db-462d-abbb-a661f9938978 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:56 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:56 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD Sep 25 16:10:56 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c7d391d4-fe90-4b2e-9822-105038d66767" returned: 0 in 0.766s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978 1073741824 Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Lock "cinder-quobyte-c7d391d4-fe90-4b2e-9822-105038d66767" released by "delete_volume" :: held 1.824s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:56 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:56 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Created reservations ['2ff21eff-affe-4f90-9f94-502c8fd8133b', '782590be-b5d2-406f-a9de-cd2168024148', '5d624b9f-df19-4c62-9547-630e2c089847', '9fb5e510-5691-4455-9de0-c84d83250114'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:57 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:57 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:57 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD" returned: 0 in 0.591s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:57 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.642s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Deleted volume successfully. Sep 25 16:10:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04eab1e-4af0-41de-8038-02ed31325b3c tempest-ServerActionsTestOtherA-1750413974 None] Lock "cinder-c7d391d4-fe90-4b2e-9822-105038d66767-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:58 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978 1073741824" returned: 0 in 1.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:58 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978 Sep 25 16:10:58 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:58 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:10:58 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:58 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978" returned: 0 in 0.650s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1016984414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92db75cf-cb09-480b-884f-df2b4cb2c1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394cebeef5e1483ab79a4cf8b19f099c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:53Z,use_quota=True,user_id='b06a9040fcf04d7380ae054d9c3ed982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Creating volume 92db75cf-cb09-480b-884f-df2b4cb2c1a8 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:58 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:59 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 1073741824 Sep 25 16:10:59 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b394e7ec-ac11-482e-a08b-279e41ed28a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c059667-85db-462d-abbb-a661f9938978', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7819a979-b4f6-4e0f-8518-883bbc8bae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Volume volume-1c059667-85db-462d-abbb-a661f9938978 (1c059667-85db-462d-abbb-a661f9938978): created successfully Sep 25 16:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7819a979-b4f6-4e0f-8518-883bbc8bae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (903e15ca-2b33-46a7-b9f2-588ed73530c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c088b1cb-c745-486d-8727-84749b59b508 tempest-VolumesActionsTest-910658753 None] Created volume successfully. Sep 25 16:10:59 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.822s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:11:00 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 1073741824" returned: 0 in 1.067s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:00 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 Sep 25 16:11:00 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d21800b5-c165-4745-a508-c5315980ca1e tempest-VolumesActionsTest-910658753 None] Acquiring lock "cinder-1c059667-85db-462d-abbb-a661f9938978" by "attach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d21800b5-c165-4745-a508-c5315980ca1e tempest-VolumesActionsTest-910658753 None] Lock "cinder-1c059667-85db-462d-abbb-a661f9938978" acquired by "attach_volume" :: waited 0.053s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=96,cinder:UPDATE=112,cinder:INSERT=33,cinder:DELETE=5 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:11:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d21800b5-c165-4745-a508-c5315980ca1e tempest-VolumesActionsTest-910658753 None] Attaching volume 1c059667-85db-462d-abbb-a661f9938978 to instance 3d943238-3ef7-4526-bcf2-e0a20d69b488 at mountpoint /dev/vdb on host None. Sep 25 16:11:00 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8" returned: 0 in 0.588s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d21800b5-c165-4745-a508-c5315980ca1e tempest-VolumesActionsTest-910658753 None] Attach volume completed successfully. Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d21800b5-c165-4745-a508-c5315980ca1e tempest-VolumesActionsTest-910658753 None] Lock "cinder-1c059667-85db-462d-abbb-a661f9938978" released by "attach_volume" :: held 0.303s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:00 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Attempting download of 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume 92db75cf-cb09-480b-884f-df2b4cb2c1a8. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:11:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1242acc8-33fe-4eee-9a79-aaccb67ee470]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_ih4m0en5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:01 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_ih4m0en5 Sep 25 16:11:01 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:01 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_ih4m0en5" returned: 0 in 0.669s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_ih4m0en5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:01 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_ih4m0en5 Sep 25 16:11:01 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:02 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_ih4m0en5" returned: 1 in 0.439s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_ih4m0en5' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:11:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[41587740-03d8-439b-9245-391795ad3256]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:02 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD Sep 25 16:11:02 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-eece49d1-2174-42cc-ad7d-8818fbaaf466 tempest-VolumesActionsTest-1706450697 None] Terminate volume connection completed successfully. Sep 25 16:11:02 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:02 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87314) copy_or_move_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1011}} Sep 25 16:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 iflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-eece49d1-2174-42cc-ad7d-8818fbaaf466 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "cinder-1c059667-85db-462d-abbb-a661f9938978-detach_volume" by "detach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:02 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 iflag=direct Sep 25 16:11:02 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-eece49d1-2174-42cc-ad7d-8818fbaaf466 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-1c059667-85db-462d-abbb-a661f9938978-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-eece49d1-2174-42cc-ad7d-8818fbaaf466 tempest-VolumesActionsTest-1706450697 None] Detaching volume 1c059667-85db-462d-abbb-a661f9938978 from instance 3d943238-3ef7-4526-bcf2-e0a20d69b488. Sep 25 16:11:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-eece49d1-2174-42cc-ad7d-8818fbaaf466 tempest-VolumesActionsTest-1706450697 None] Detach volume completed successfully. Sep 25 16:11:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-eece49d1-2174-42cc-ad7d-8818fbaaf466 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-1c059667-85db-462d-abbb-a661f9938978-detach_volume" released by "detach_volume" :: held 0.238s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:03 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 iflag=direct" returned: 0 in 0.675s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:03 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 oflag=direct Sep 25 16:11:03 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-95b32080-88a3-440e-b89a-0e120e93f297 tempest-VolumesActionsTest-910658753 None] Acquiring lock "cinder-1c059667-85db-462d-abbb-a661f9938978-detach_volume" by "detach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-95b32080-88a3-440e-b89a-0e120e93f297 tempest-VolumesActionsTest-910658753 None] Lock "cinder-1c059667-85db-462d-abbb-a661f9938978-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-95b32080-88a3-440e-b89a-0e120e93f297 tempest-VolumesActionsTest-910658753 None] Volume detach called, but volume not attached. Sep 25 16:11:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-95b32080-88a3-440e-b89a-0e120e93f297 tempest-VolumesActionsTest-910658753 None] Lock "cinder-1c059667-85db-462d-abbb-a661f9938978-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Acquiring lock "cinder-1c059667-85db-462d-abbb-a661f9938978-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:04 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 oflag=direct" returned: 0 in 0.714s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Lock "cinder-1c059667-85db-462d-abbb-a661f9938978-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:04 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:11:04 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:04 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:DELETE=13,cinder:SELECT=89,cinder:INSERT=26,cinder:UPDATE=120 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:11:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Acquiring lock "cinder-quobyte-1c059667-85db-462d-abbb-a661f9938978" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Lock "cinder-quobyte-1c059667-85db-462d-abbb-a661f9938978" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fdb02a-5988-42e9-9595-6019cfb900ae]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:04 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978 Sep 25 16:11:04 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:05 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978" returned: 0 in 0.998s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:05 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978 Sep 25 16:11:05 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:05 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 1.468s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_d4xt1dbldevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8, size 21.00 MB, duration 1.47 sec {{(pid=87314) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:11:05 devstack cinder-volume[87314]: INFO cinder.volume.volume_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Volume copy 21.00 MB at 14.27 MB/s Sep 25 16:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:05 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 1G Sep 25 16:11:05 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:06 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c059667-85db-462d-abbb-a661f9938978" returned: 0 in 0.526s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Lock "cinder-quobyte-1c059667-85db-462d-abbb-a661f9938978" released by "delete_volume" :: held 1.628s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Created reservations ['6fa66d47-83ea-4b78-b0a6-9a75f0952d1b', 'ecf509bb-21ee-4292-84a4-4089cdb75779', 'f5c55e7e-6b01-4e03-8962-434cda1356d0', 'c07799fa-66f2-404d-a779-5c68dc3a4909'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:06 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:06 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:06 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 1G" returned: 0 in 0.887s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Downloaded image 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume 92db75cf-cb09-480b-884f-df2b4cb2c1a8 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa for user b06a9040fcf04d7380ae054d9c3ed982 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Marking volume 92db75cf-cb09-480b-884f-df2b4cb2c1a8 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Copying metadata from image 0d17311a-0d04-4242-8696-17a222efd8fa to 92db75cf-cb09-480b-884f-df2b4cb2c1a8. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Creating volume glance metadata for volume 92db75cf-cb09-480b-884f-df2b4cb2c1a8 backed by image 0d17311a-0d04-4242-8696-17a222efd8fa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492d7839-2934-4385-8fe8-36d0fc5db82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a401b8-98e1-4ca8-8989-3e5e602d4f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Volume volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 (92db75cf-cb09-480b-884f-df2b4cb2c1a8): created successfully Sep 25 16:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a401b8-98e1-4ca8-8989-3e5e602d4f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Flow 'volume_create_manager' (bd9641af-81ad-4076-b12d-748044402d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1e0dad22-2b0b-4310-8b0b-b76693f530cc tempest-VolumesExtendTest-1170393828 None] Created volume successfully. Sep 25 16:11:07 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.753s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:07 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Deleted volume successfully. Sep 25 16:11:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb893064-dbf4-4238-b806-8fe6e713bc49 tempest-VolumesActionsTest-910658753 None] Lock "cinder-1c059667-85db-462d-abbb-a661f9938978-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b936d7c-15b6-435c-acce-b35efd69fc91 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b936d7c-15b6-435c-acce-b35efd69fc91 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cf1a0e-f347-496f-a080-a25a9963659c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b936d7c-15b6-435c-acce-b35efd69fc91 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:07 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 Sep 25 16:11:07 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:08 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b936d7c-15b6-435c-acce-b35efd69fc91 tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8" returned: 0 in 0.724s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b936d7c-15b6-435c-acce-b35efd69fc91 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 2G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b936d7c-15b6-435c-acce-b35efd69fc91 tempest-VolumesExtendTest-1170393828 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 2G" returned: 0 in 0.180s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b936d7c-15b6-435c-acce-b35efd69fc91 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.947s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9b936d7c-15b6-435c-acce-b35efd69fc91 tempest-VolumesExtendTest-1170393828 None] Extend volume completed successfully. Sep 25 16:11:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "cinder-92db75cf-cb09-480b-884f-df2b4cb2c1a8-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-92db75cf-cb09-480b-884f-df2b4cb2c1a8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "cinder-quobyte-92db75cf-cb09-480b-884f-df2b4cb2c1a8" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-quobyte-92db75cf-cb09-480b-884f-df2b4cb2c1a8" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ffd138-66ef-48cb-852b-078aca0a18d0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:09 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 Sep 25 16:11:09 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:10 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8" returned: 0 in 0.707s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:10 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8 Sep 25 16:11:10 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:10 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-92db75cf-cb09-480b-884f-df2b4cb2c1a8" returned: 0 in 0.503s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Flow 'volume_create_manager' (f7afc539-750f-490b-8529-0ffc229da948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b68e8d-bffe-4781-8d2b-02b314ce9c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-quobyte-92db75cf-cb09-480b-884f-df2b4cb2c1a8" released by "delete_volume" :: held 1.310s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b68e8d-bffe-4781-8d2b-02b314ce9c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-71171677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d2eb36-d8c7-4166-bd81-4da0de6c91dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='577f60c063ce4f27af5e6fbc45c7b791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:11Z,use_quota=True,user_id='ef2be9085c83408a9cc36451c87bde0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000862c0-68ed-46c7-952b-01aed444af17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000862c0-68ed-46c7-952b-01aed444af17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98270999-db94-4d50-ab64-80b10605149a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98270999-db94-4d50-ab64-80b10605149a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d2eb36-d8c7-4166-bd81-4da0de6c91dc', 'volume_name': 'volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3427bc55-0ac6-4564-8b5d-75293173be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3427bc55-0ac6-4564-8b5d-75293173be9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f852cfac-aab6-434e-92b7-b06387c93b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:10 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Volume 04d2eb36-d8c7-4166-bd81-4da0de6c91dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc', 'volume_size': 1} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-71171677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d2eb36-d8c7-4166-bd81-4da0de6c91dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='577f60c063ce4f27af5e6fbc45c7b791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:11Z,use_quota=True,user_id='ef2be9085c83408a9cc36451c87bde0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Creating volume 04d2eb36-d8c7-4166-bd81-4da0de6c91dc {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:10 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:10 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc 1073741824 Sep 25 16:11:10 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:10 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Created reservations ['45642785-33b0-4cce-8285-5b22e286ef7c', '8c6b861f-5ff8-42a6-b86e-d3e1d054458a', '811d6594-4c05-4b3e-be00-c000021440db', 'd8ce9c0a-614d-4665-a1ed-005101c51278'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:11 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:11 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:11 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.317s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Deleted volume successfully. Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-66c65ccd-46c2-467c-93bc-2ead27848632 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-92db75cf-cb09-480b-884f-df2b4cb2c1a8-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:11 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc 1073741824" returned: 0 in 0.676s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:11 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc Sep 25 16:11:11 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (548bbc86-fee1-4467-8e29-86d9fa392a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6b5038-7097-424f-a7b0-324c933bc086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6b5038-7097-424f-a7b0-324c933bc086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-602058250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e155c96-2890-4f08-afa8-3ffd77b26395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:12Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0716ff8a-d7e4-4e9f-96d5-f6eec74448e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0716ff8a-d7e4-4e9f-96d5-f6eec74448e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada56d0d-cc62-4deb-a2ea-e1410f62a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada56d0d-cc62-4deb-a2ea-e1410f62a365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e155c96-2890-4f08-afa8-3ffd77b26395', 'volume_name': 'volume-6e155c96-2890-4f08-afa8-3ffd77b26395', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff44a9e-a00f-46d1-85aa-e2ef1ba7d3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff44a9e-a00f-46d1-85aa-e2ef1ba7d3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4749034-cc16-4913-8444-0698c8475b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Volume 6e155c96-2890-4f08-afa8-3ffd77b26395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e155c96-2890-4f08-afa8-3ffd77b26395', 'volume_size': 1} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:11 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-602058250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e155c96-2890-4f08-afa8-3ffd77b26395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:12Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Creating volume 6e155c96-2890-4f08-afa8-3ffd77b26395 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f852cfac-aab6-434e-92b7-b06387c93b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112b82ef-9157-491c-a086-d96955fb957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:12 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395 1073741824 Sep 25 16:11:12 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Volume volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc (04d2eb36-d8c7-4166-bd81-4da0de6c91dc): created successfully Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112b82ef-9157-491c-a086-d96955fb957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Flow 'volume_create_manager' (f7afc539-750f-490b-8529-0ffc229da948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4acb3a33-0f49-4c2a-aa0e-1cd4473c9e17 tempest-AbsoluteLimitsTests-1419848565 None] Created volume successfully. Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Flow 'volume_create_manager' (2e7c6ff1-8e44-452c-a98a-11e6ff260ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97686ef-b4c1-4f58-a516-604417a11c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97686ef-b4c1-4f58-a516-604417a11c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-776450866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6d7f68-5406-46f1-b1d6-60f2290a439e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394cebeef5e1483ab79a4cf8b19f099c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:12Z,use_quota=True,user_id='b06a9040fcf04d7380ae054d9c3ed982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848d3588-7afe-44f7-a696-4fd5ddcfb5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848d3588-7afe-44f7-a696-4fd5ddcfb5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75d6dad-5f9a-4c11-80c5-11ca218e74ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75d6dad-5f9a-4c11-80c5-11ca218e74ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6d7f68-5406-46f1-b1d6-60f2290a439e', 'volume_name': 'volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17e736d-8aa8-4e15-8b27-ad8e70cd4c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17e736d-8aa8-4e15-8b27-ad8e70cd4c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daef300-a114-4043-a84c-4c4fa6a7fa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Volume 2f6d7f68-5406-46f1-b1d6-60f2290a439e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e', 'volume_size': 1} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:12 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395 1073741824" returned: 0 in 0.666s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:12 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395 Sep 25 16:11:12 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:13 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395" returned: 0 in 0.320s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-776450866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6d7f68-5406-46f1-b1d6-60f2290a439e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394cebeef5e1483ab79a4cf8b19f099c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:12Z,use_quota=True,user_id='b06a9040fcf04d7380ae054d9c3ed982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Creating volume 2f6d7f68-5406-46f1-b1d6-60f2290a439e {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:13 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4749034-cc16-4913-8444-0698c8475b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e155c96-2890-4f08-afa8-3ffd77b26395', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:13 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e 1073741824 Sep 25 16:11:13 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca82e974-4a97-41f9-9280-f4fdd819f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Volume volume-6e155c96-2890-4f08-afa8-3ffd77b26395 (6e155c96-2890-4f08-afa8-3ffd77b26395): created successfully Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca82e974-4a97-41f9-9280-f4fdd819f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (548bbc86-fee1-4467-8e29-86d9fa392a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Acquiring lock "cinder-04d2eb36-d8c7-4166-bd81-4da0de6c91dc-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-112e3714-3aed-4fe1-a2f8-7f5cb774786a tempest-VolumesActionsTest-910658753 None] Created volume successfully. Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Lock "cinder-04d2eb36-d8c7-4166-bd81-4da0de6c91dc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Acquiring lock "cinder-quobyte-04d2eb36-d8c7-4166-bd81-4da0de6c91dc" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Lock "cinder-quobyte-04d2eb36-d8c7-4166-bd81-4da0de6c91dc" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcf28d2-6c5d-4fe4-b781-95e7372a5657]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:13 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc Sep 25 16:11:13 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:13 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e 1073741824" returned: 0 in 0.737s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:13 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e Sep 25 16:11:13 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:13 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc" returned: 0 in 0.636s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:13 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc Sep 25 16:11:13 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "cinder-6e155c96-2890-4f08-afa8-3ffd77b26395-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-6e155c96-2890-4f08-afa8-3ffd77b26395-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "cinder-quobyte-6e155c96-2890-4f08-afa8-3ffd77b26395" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-quobyte-6e155c96-2890-4f08-afa8-3ffd77b26395" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:14 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e" returned: 0 in 0.376s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd34a9-df1a-4a8e-8888-bc6055cb76ba]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daef300-a114-4043-a84c-4c4fa6a7fa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7732d4f7-5a04-41e4-8996-958e94bec9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Volume volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e (2f6d7f68-5406-46f1-b1d6-60f2290a439e): created successfully Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7732d4f7-5a04-41e4-8996-958e94bec9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Flow 'volume_create_manager' (2e7c6ff1-8e44-452c-a98a-11e6ff260ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0601a22b-1162-469d-8d2b-e761a9352575 tempest-VolumesExtendTest-1170393828 None] Created volume successfully. Sep 25 16:11:14 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04d2eb36-d8c7-4166-bd81-4da0de6c91dc" returned: 0 in 0.448s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Lock "cinder-quobyte-04d2eb36-d8c7-4166-bd81-4da0de6c91dc" released by "delete_volume" :: held 1.154s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:14 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395 Sep 25 16:11:14 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Created reservations ['045ca3a2-52a1-4813-a272-fbab7d8163fc', 'eabacda6-bb62-4988-8f21-f89205ef6e8c', 'bd4fcccc-07bf-4475-8bfe-1f51611c2a0c', 'e92ab544-1f3c-4ab4-885c-741e807b32de'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:14 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:14 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Creating offline snapshot 99076fa8-8ec5-42cb-9b45-581ae6faf0a6 of volume 2f6d7f68-5406-46f1-b1d6-60f2290a439e {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:11:14 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395" returned: 0 in 0.652s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a9d83-083c-4be2-a60d-a6a189caa68c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:14 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395 Sep 25 16:11:14 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:15 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.479s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:15 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e Sep 25 16:11:15 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Deleted volume successfully. Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c9f56481-a9ca-4b07-890b-7679f704c9b4 tempest-AbsoluteLimitsTests-1419848565 None] Lock "cinder-04d2eb36-d8c7-4166-bd81-4da0de6c91dc-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:15 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6e155c96-2890-4f08-afa8-3ffd77b26395" returned: 0 in 0.459s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-quobyte-6e155c96-2890-4f08-afa8-3ffd77b26395" released by "delete_volume" :: held 1.188s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Created reservations ['99a66b11-c0fd-4632-b831-08b27ef74c1f', '93d3364e-3c2c-474a-bf27-e297e8e0badd', '1a3dfd04-7b22-4a53-9931-b245a2843318', 'e408aa8b-f73f-46af-a5f4-c79254d1bb8e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:15 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e" returned: 0 in 0.591s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:15 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 1G Sep 25 16:11:15 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:15 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:15 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:15 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.339s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Deleted volume successfully. Sep 25 16:11:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32d043c3-d833-480d-bea5-7e3bed0989d3 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-6e155c96-2890-4f08-afa8-3ffd77b26395-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:16 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 1G" returned: 0 in 0.641s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:16 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 Sep 25 16:11:16 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:16 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6" returned: 0 in 0.490s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:16 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 is being set with open permissions: ugo+rw Sep 25 16:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:16 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 Sep 25 16:11:16 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:17 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:17 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.info Sep 25 16:11:17 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (97ce106b-7726-4c3c-86cf-98a9d4604c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7c4bf4-9e64-4805-829d-fde1118d3f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7c4bf4-9e64-4805-829d-fde1118d3f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-682544793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731b7783-3c3b-4893-bc80-be7389de91f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:17Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb8c264-d0e0-4050-b42f-2078784c09c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb8c264-d0e0-4050-b42f-2078784c09c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b78f7c0-54ad-4c37-83d1-a29834c5b2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b78f7c0-54ad-4c37-83d1-a29834c5b2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731b7783-3c3b-4893-bc80-be7389de91f7', 'volume_name': 'volume-731b7783-3c3b-4893-bc80-be7389de91f7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2716fa-fe8a-40a1-9948-bae18161e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:17 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2716fa-fe8a-40a1-9948-bae18161e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d732554-193b-4a6c-a915-eb37bb3f7055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:17 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Volume 731b7783-3c3b-4893-bc80-be7389de91f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731b7783-3c3b-4893-bc80-be7389de91f7', 'volume_size': 1} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.info" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:17 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.info is being set with open permissions: ugo+rw Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:17 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.info Sep 25 16:11:17 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:17 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.info" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.045s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-682544793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731b7783-3c3b-4893-bc80-be7389de91f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:17Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Creating volume 731b7783-3c3b-4893-bc80-be7389de91f7 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:17 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:17 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7 1073741824 Sep 25 16:11:17 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ccc035c9-51a9-4c89-ba45-9ffc0c1855a2 tempest-VolumesExtendTest-1170393828 None] Create snapshot completed successfully Sep 25 16:11:18 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7 1073741824" returned: 0 in 0.696s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:18 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7 Sep 25 16:11:18 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:19 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7" returned: 0 in 0.412s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d732554-193b-4a6c-a915-eb37bb3f7055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731b7783-3c3b-4893-bc80-be7389de91f7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e21521-48ec-4024-bf0c-b73ec0c6f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Volume volume-731b7783-3c3b-4893-bc80-be7389de91f7 (731b7783-3c3b-4893-bc80-be7389de91f7): created successfully Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e21521-48ec-4024-bf0c-b73ec0c6f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (97ce106b-7726-4c3c-86cf-98a9d4604c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d1a415b0-8e14-4992-ab16-3e45bcab3511 tempest-VolumesActionsTest-910658753 None] Created volume successfully. Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-901e2dfe-1334-42b7-a3de-03ab301bcef7 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-901e2dfe-1334-42b7-a3de-03ab301bcef7 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e7a85b-6b7e-4cc7-ac1d-ef3ca0e9deee]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-901e2dfe-1334-42b7-a3de-03ab301bcef7 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:19 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e Sep 25 16:11:19 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "cinder-731b7783-3c3b-4893-bc80-be7389de91f7-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-731b7783-3c3b-4893-bc80-be7389de91f7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "cinder-quobyte-731b7783-3c3b-4893-bc80-be7389de91f7" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-quobyte-731b7783-3c3b-4893-bc80-be7389de91f7" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[566414cb-10cc-4aee-bc44-2760d4d32a92]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:20 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7 Sep 25 16:11:20 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-901e2dfe-1334-42b7-a3de-03ab301bcef7 tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e" returned: 0 in 0.804s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:20 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-901e2dfe-1334-42b7-a3de-03ab301bcef7 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 2G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-901e2dfe-1334-42b7-a3de-03ab301bcef7 tempest-VolumesExtendTest-1170393828 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 2G" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-901e2dfe-1334-42b7-a3de-03ab301bcef7 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.148s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-901e2dfe-1334-42b7-a3de-03ab301bcef7 tempest-VolumesExtendTest-1170393828 None] Extend volume completed successfully. Sep 25 16:11:20 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7" returned: 0 in 0.751s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:20 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7 Sep 25 16:11:20 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:21 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-731b7783-3c3b-4893-bc80-be7389de91f7" returned: 0 in 0.430s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-quobyte-731b7783-3c3b-4893-bc80-be7389de91f7" released by "delete_volume" :: held 1.231s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Created reservations ['5f80bc93-7bac-4d9b-8f87-3e01592f1bc5', 'f7f0de78-a9d6-419a-9ec3-ba945c72dda6', 'd440baf6-20fe-4e5c-bcfb-1afa5693b02f', '63832a7f-310b-4eb6-b982-74b1833a198d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:21 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:21 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:21 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.354s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Deleted volume successfully. Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e9d3870e-42b7-4805-9e03-b3b5aab2be90 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-731b7783-3c3b-4893-bc80-be7389de91f7-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "cinder-99076fa8-8ec5-42cb-9b45-581ae6faf0a6-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-99076fa8-8ec5-42cb-9b45-581ae6faf0a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "cinder-quobyte-2f6d7f68-5406-46f1-b1d6-60f2290a439e" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-quobyte-2f6d7f68-5406-46f1-b1d6-60f2290a439e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "cinder-quobyte-99076fa8-8ec5-42cb-9b45-581ae6faf0a6" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-quobyte-99076fa8-8ec5-42cb-9b45-581ae6faf0a6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Deleting offline snapshot 99076fa8-8ec5-42cb-9b45-581ae6faf0a6 of volume 2f6d7f68-5406-46f1-b1d6-60f2290a439e {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:11:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] snapshot_file for this snap is: volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:11:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d79b8a9-e900-4f85-b493-6a496f1149eb]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:22 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 Sep 25 16:11:22 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:22 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6" returned: 0 in 0.628s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:11:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9b1ba-839e-4bd7-877b-d36c6f23280d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:22 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e Sep 25 16:11:22 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (9eed32df-3afd-47c5-a0b9-4f5d60d7897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc6a601-f0be-47f7-a75a-da3f5c4d9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc6a601-f0be-47f7-a75a-da3f5c4d9825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851482794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cecfab2-02c1-4fd6-a350-2b4b922c2699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:23Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:23 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0becfa60-d55a-4a85-a296-8613f709e2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0becfa60-d55a-4a85-a296-8613f709e2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a48f2f5-b21f-4892-926b-10e43a46e88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a48f2f5-b21f-4892-926b-10e43a46e88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cecfab2-02c1-4fd6-a350-2b4b922c2699', 'volume_name': 'volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c511b7-5965-4983-bb5d-e8a724f9c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c511b7-5965-4983-bb5d-e8a724f9c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a592a46f-3b3e-47a3-b204-28087459fc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Volume 7cecfab2-02c1-4fd6-a350-2b4b922c2699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699', 'volume_size': 1} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851482794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cecfab2-02c1-4fd6-a350-2b4b922c2699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:23Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Creating volume 7cecfab2-02c1-4fd6-a350-2b4b922c2699 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:23 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e" returned: 0 in 0.707s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:23 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 1073741824 Sep 25 16:11:23 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:23 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 Sep 25 16:11:23 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:24 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6" returned: 0 in 0.712s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:24 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 1073741824" returned: 0 in 0.753s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:24 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6 Sep 25 16:11:24 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:24 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 Sep 25 16:11:24 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:24 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e.99076fa8-8ec5-42cb-9b45-581ae6faf0a6" returned: 0 in 0.500s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:24 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699" returned: 0 in 0.476s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-quobyte-99076fa8-8ec5-42cb-9b45-581ae6faf0a6" released by "_delete_snapshot" :: held 2.763s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-quobyte-2f6d7f68-5406-46f1-b1d6-60f2290a439e" released by "delete_snapshot" :: held 2.798s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a592a46f-3b3e-47a3-b204-28087459fc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643204a3-1abf-4fbe-8ad9-d68b3edc3121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:24 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Volume volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 (7cecfab2-02c1-4fd6-a350-2b4b922c2699): created successfully Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643204a3-1abf-4fbe-8ad9-d68b3edc3121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (9eed32df-3afd-47c5-a0b9-4f5d60d7897f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8c026878-91eb-417f-b8d9-8311e2357bba tempest-VolumesActionsTest-910658753 None] Created volume successfully. Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Created reservations ['8659a6cd-f0d3-466c-b058-b7d88172bdf8', '9f895c9c-915a-4d67-b47f-ad0348413ee1', '11af6ae5-2d02-44a1-9eda-f2ae3a080267', '9d6197db-4395-4196-b9b8-9fcbe5811e26'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Delete snapshot completed successfully. Sep 25 16:11:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d2667862-0a86-43b8-9f6e-b55c1dad3c53 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-99076fa8-8ec5-42cb-9b45-581ae6faf0a6-delete_snapshot" released by "delete_snapshot" :: held 3.074s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "cinder-2f6d7f68-5406-46f1-b1d6-60f2290a439e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-2f6d7f68-5406-46f1-b1d6-60f2290a439e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "cinder-quobyte-2f6d7f68-5406-46f1-b1d6-60f2290a439e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-quobyte-2f6d7f68-5406-46f1-b1d6-60f2290a439e" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "cinder-7cecfab2-02c1-4fd6-a350-2b4b922c2699-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-7cecfab2-02c1-4fd6-a350-2b4b922c2699-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[602a8c2f-1220-4b1d-87e8-013c3635269c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "cinder-quobyte-7cecfab2-02c1-4fd6-a350-2b4b922c2699" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-quobyte-7cecfab2-02c1-4fd6-a350-2b4b922c2699" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcbb5a9-486b-4e48-ba0b-08bc585ab550]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:25 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e Sep 25 16:11:25 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:25 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 Sep 25 16:11:25 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:26 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e" returned: 0 in 0.593s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:26 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e Sep 25 16:11:26 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:26 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699" returned: 0 in 0.597s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:26 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699 Sep 25 16:11:26 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:26 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2f6d7f68-5406-46f1-b1d6-60f2290a439e" returned: 0 in 0.536s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-quobyte-2f6d7f68-5406-46f1-b1d6-60f2290a439e" released by "delete_volume" :: held 1.264s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Created reservations ['500c4b0f-f8cb-4910-9bc9-9ba218ebd9c7', '71c0cb69-3130-4964-8c69-c5be7ce23669', '396ed8b2-7eda-4559-b88f-93ad4444c11f', '405b1b31-91d5-4c19-9f72-98436caa1110'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:26 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7cecfab2-02c1-4fd6-a350-2b4b922c2699" returned: 0 in 0.525s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-quobyte-7cecfab2-02c1-4fd6-a350-2b4b922c2699" released by "delete_volume" :: held 1.211s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Created reservations ['8049b9e1-8161-452a-8f0a-95bf5dee0e31', 'cf1daa80-3c84-4114-9d0b-251a8b60840a', 'b70e996e-430f-4888-a960-cab528d3a0d3', '095c8061-350f-4ab0-9db9-f73e1809ff0f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:27 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:27 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:27 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:27 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:27 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.417s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Deleted volume successfully. Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-234809e4-d7a5-4b4b-a177-20a34899bbc5 tempest-VolumesExtendTest-1170393828 None] Lock "cinder-2f6d7f68-5406-46f1-b1d6-60f2290a439e-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:27 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Deleted volume successfully. Sep 25 16:11:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7571a630-58d1-47c7-84d8-c2fb2b2f5382 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-7cecfab2-02c1-4fd6-a350-2b4b922c2699-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (bc117859-4217-4209-9b1d-5d8328f68cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9922234a-b747-499d-8dc1-0563989df422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9922234a-b747-499d-8dc1-0563989df422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-554294227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c28c88-0ec7-4799-afbf-68c85230cb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:29Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b4d31d-e637-4d89-a641-76d8b6203989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b4d31d-e637-4d89-a641-76d8b6203989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b2ca5c-7975-432d-811e-e50f53d0e494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b2ca5c-7975-432d-811e-e50f53d0e494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c28c88-0ec7-4799-afbf-68c85230cb08', 'volume_name': 'volume-40c28c88-0ec7-4799-afbf-68c85230cb08', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9abfc6-62cf-4152-a9fb-d0d9c0bf3002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9abfc6-62cf-4152-a9fb-d0d9c0bf3002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915632b1-752f-43d3-b7dc-bd7f242753b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Volume 40c28c88-0ec7-4799-afbf-68c85230cb08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c28c88-0ec7-4799-afbf-68c85230cb08', 'volume_size': 1} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-554294227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c28c88-0ec7-4799-afbf-68c85230cb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:29Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Creating volume 40c28c88-0ec7-4799-afbf-68c85230cb08 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:29 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:29 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08 1073741824 Sep 25 16:11:29 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:29 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08 1073741824" returned: 0 in 0.626s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:29 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08 Sep 25 16:11:29 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:30 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915632b1-752f-43d3-b7dc-bd7f242753b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c28c88-0ec7-4799-afbf-68c85230cb08', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0daab8e4-747c-4421-861c-3bfbf9f186e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Volume volume-40c28c88-0ec7-4799-afbf-68c85230cb08 (40c28c88-0ec7-4799-afbf-68c85230cb08): created successfully Sep 25 16:11:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0daab8e4-747c-4421-861c-3bfbf9f186e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (bc117859-4217-4209-9b1d-5d8328f68cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6b967d55-1957-4b69-aef5-171f6653c0f8 tempest-VolumesActionsTest-910658753 None] Created volume successfully. Sep 25 16:11:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "cinder-40c28c88-0ec7-4799-afbf-68c85230cb08-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-40c28c88-0ec7-4799-afbf-68c85230cb08-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "cinder-quobyte-40c28c88-0ec7-4799-afbf-68c85230cb08" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-quobyte-40c28c88-0ec7-4799-afbf-68c85230cb08" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1262b5-7b2b-436e-bb1f-af740de0cd66]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:31 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08 Sep 25 16:11:31 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:31 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08" returned: 0 in 0.506s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:31 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08 Sep 25 16:11:31 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:32 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-40c28c88-0ec7-4799-afbf-68c85230cb08" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-quobyte-40c28c88-0ec7-4799-afbf-68c85230cb08" released by "delete_volume" :: held 0.920s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Created reservations ['8dacb921-6284-47c3-aa39-ffc6dac167dc', '6d6a286c-0bc3-45a5-8ee1-99f4c0d6ff87', '24ae3e7f-256c-4392-a4d1-e7efcffa1193', '937f7f00-2380-4e00-9261-6d6d826c3b64'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:32 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:32 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:32 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.558s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Deleted volume successfully. Sep 25 16:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-85ede5bf-3784-486e-8183-ab2860bb3217 tempest-VolumesActionsTest-1706450697 None] Lock "cinder-40c28c88-0ec7-4799-afbf-68c85230cb08-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (60aad898-7fea-41d5-9946-a29cd4cbf3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af1a328-5f76-4277-b002-d966581fdf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af1a328-5f76-4277-b002-d966581fdf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-99907254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9d8558-29cd-4083-a889-7017ef9cc0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:34Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34af62b-c523-4754-bc47-c5aa722e0857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34af62b-c523-4754-bc47-c5aa722e0857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8ef5b2-5d4c-4620-a751-acf146a7b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8ef5b2-5d4c-4620-a751-acf146a7b71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a9d8558-29cd-4083-a889-7017ef9cc0f7', 'volume_name': 'volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86a1425-03f6-4933-8035-9e01da0a0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86a1425-03f6-4933-8035-9e01da0a0272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ea660a-f90d-4b7a-8e28-b86938e2f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Volume 1a9d8558-29cd-4083-a889-7017ef9cc0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7', 'volume_size': 1} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-99907254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9d8558-29cd-4083-a889-7017ef9cc0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70be4d536d64f54a84852fdcb617de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:34Z,use_quota=True,user_id='603540917de94f23a9f95e51b3204eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Creating volume 1a9d8558-29cd-4083-a889-7017ef9cc0f7 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:34 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:34 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 1073741824 Sep 25 16:11:34 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:35 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 1073741824" returned: 0 in 0.680s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:35 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 Sep 25 16:11:35 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:35 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ea660a-f90d-4b7a-8e28-b86938e2f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11df75b6-b68c-4da3-9a04-23817ba20720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Volume volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 (1a9d8558-29cd-4083-a889-7017ef9cc0f7): created successfully Sep 25 16:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11df75b6-b68c-4da3-9a04-23817ba20720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Flow 'volume_create_manager' (60aad898-7fea-41d5-9946-a29cd4cbf3a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8899f075-f7de-4086-8214-9f7d766ff4c5 tempest-VolumesActionsTest-910658753 None] Created volume successfully. Sep 25 16:11:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Acquiring lock "cinder-1a9d8558-29cd-4083-a889-7017ef9cc0f7-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Lock "cinder-1a9d8558-29cd-4083-a889-7017ef9cc0f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Acquiring lock "cinder-quobyte-1a9d8558-29cd-4083-a889-7017ef9cc0f7" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Lock "cinder-quobyte-1a9d8558-29cd-4083-a889-7017ef9cc0f7" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bcc8f0-eb41-4a2a-9575-a4422ba5c259]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:37 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 Sep 25 16:11:37 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:38 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7" returned: 0 in 0.585s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:38 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7 Sep 25 16:11:38 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:38 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1a9d8558-29cd-4083-a889-7017ef9cc0f7" returned: 0 in 0.555s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Lock "cinder-quobyte-1a9d8558-29cd-4083-a889-7017ef9cc0f7" released by "delete_volume" :: held 1.227s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Created reservations ['b14855d0-e8c5-4226-a7cd-92c5758232ec', 'fc6cbaeb-8a8a-45b7-9e31-9159821842e6', 'dc8416eb-9347-4016-856d-e3346e1d0d4e', '185016e3-dedf-4d17-b7eb-d4602ded7dba'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:38 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:38 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:39 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.353s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Deleted volume successfully. Sep 25 16:11:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1c398163-b79a-44f9-98bf-f8216626193e tempest-VolumesActionsTest-910658753 None] Lock "cinder-1a9d8558-29cd-4083-a889-7017ef9cc0f7-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Flow 'volume_create_manager' (27d7d9ab-c52b-4fe9-8bfc-634d841dc91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80886d82-ed0d-40da-aa13-122c5e0c5c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80886d82-ed0d-40da-aa13-122c5e0c5c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1380827593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950e238a-868c-4b39-b868-bff3b2a63477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5d6d949f2d4c0d9a201f824993ec2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:42Z,use_quota=True,user_id='d8e0328d411046d18d3631be2dd16a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4b0d6b-2a6c-4c9a-a753-bb8b4634d497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4b0d6b-2a6c-4c9a-a753-bb8b4634d497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1348640e-9022-409c-b8b8-5625f55848d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1348640e-9022-409c-b8b8-5625f55848d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950e238a-868c-4b39-b868-bff3b2a63477', 'volume_name': 'volume-950e238a-868c-4b39-b868-bff3b2a63477', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1341fe-3b7a-4de7-a9ea-5910086f1475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1341fe-3b7a-4de7-a9ea-5910086f1475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc9f8e6-76f6-4be0-9989-d0016ea009c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Volume 950e238a-868c-4b39-b868-bff3b2a63477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950e238a-868c-4b39-b868-bff3b2a63477', 'volume_size': 1} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1380827593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950e238a-868c-4b39-b868-bff3b2a63477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5d6d949f2d4c0d9a201f824993ec2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:42Z,use_quota=True,user_id='d8e0328d411046d18d3631be2dd16a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Creating volume 950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:41 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:41 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 1073741824 Sep 25 16:11:41 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Flow 'volume_create_manager' (e20aca1a-f687-4626-b6fc-10a53a396745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01755296-34c0-4ce2-8652-5a41ba1ee633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01755296-34c0-4ce2-8652-5a41ba1ee633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1797760980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe2c75f-3e93-4c06-aed6-a20af99d4513,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='794999b0cd7b4ae892cffe77c0f269d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:42Z,use_quota=True,user_id='0b0fc7659e3f4c13ba2ad1170910d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26d434e-c9ea-48f2-8fde-dcf6d54f6f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26d434e-c9ea-48f2-8fde-dcf6d54f6f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bc02a2-0b90-45da-8a96-f175f43bb4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bc02a2-0b90-45da-8a96-f175f43bb4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfe2c75f-3e93-4c06-aed6-a20af99d4513', 'volume_name': 'volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70db15f-2678-4842-84c9-11dd11d75c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70db15f-2678-4842-84c9-11dd11d75c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e0f8ea-783c-4143-8750-1382f572aa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Volume bfe2c75f-3e93-4c06-aed6-a20af99d4513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513', 'volume_size': 1} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:42 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 1073741824" returned: 0 in 0.750s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:42 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 Sep 25 16:11:42 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:43 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1797760980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe2c75f-3e93-4c06-aed6-a20af99d4513,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='794999b0cd7b4ae892cffe77c0f269d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:42Z,use_quota=True,user_id='0b0fc7659e3f4c13ba2ad1170910d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Creating volume bfe2c75f-3e93-4c06-aed6-a20af99d4513 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:43 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc9f8e6-76f6-4be0-9989-d0016ea009c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950e238a-868c-4b39-b868-bff3b2a63477', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:43 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 1073741824 Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6646e62-b880-4319-b691-fe556d220915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:43 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:43 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Volume volume-950e238a-868c-4b39-b868-bff3b2a63477 (950e238a-868c-4b39-b868-bff3b2a63477): created successfully Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6646e62-b880-4319-b691-fe556d220915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Flow 'volume_create_manager' (27d7d9ab-c52b-4fe9-8bfc-634d841dc91e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-df5d1020-4680-49f8-ae19-0e3e69f02a35 tempest-VolumesActionsTest-911988422 None] Created volume successfully. Sep 25 16:11:43 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 1073741824" returned: 0 in 0.666s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:43 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 Sep 25 16:11:43 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:44 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513" returned: 0 in 0.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e0f8ea-783c-4143-8750-1382f572aa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ac02d2-6acf-49c1-89d9-17057d018198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Volume volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 (bfe2c75f-3e93-4c06-aed6-a20af99d4513): created successfully Sep 25 16:11:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ac02d2-6acf-49c1-89d9-17057d018198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Flow 'volume_create_manager' (e20aca1a-f687-4626-b6fc-10a53a396745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5de41b40-1100-4965-90d5-b2f39584bdb6 tempest-VolumesListTestJSON-1675334985 None] Created volume successfully. Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Flow 'volume_create_manager' (be712fa2-5f67-4940-a67e-e274a873aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997acd60-03ce-4cd4-b8eb-a28e876b421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997acd60-03ce-4cd4-b8eb-a28e876b421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1792103718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab42b618-4a72-49ab-aa54-a43a51e469d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='794999b0cd7b4ae892cffe77c0f269d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:46Z,use_quota=True,user_id='0b0fc7659e3f4c13ba2ad1170910d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9a7a22-dfbf-4e70-97fc-00d5afefd94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9a7a22-dfbf-4e70-97fc-00d5afefd94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad26eef3-c66f-40b4-8877-c3cf1075b18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad26eef3-c66f-40b4-8877-c3cf1075b18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab42b618-4a72-49ab-aa54-a43a51e469d2', 'volume_name': 'volume-ab42b618-4a72-49ab-aa54-a43a51e469d2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0a65ee-237a-416d-8003-65d38150df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0a65ee-237a-416d-8003-65d38150df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9feeb46a-eb30-4c21-8a39-8b25b017e477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Volume ab42b618-4a72-49ab-aa54-a43a51e469d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab42b618-4a72-49ab-aa54-a43a51e469d2', 'volume_size': 1} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1792103718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab42b618-4a72-49ab-aa54-a43a51e469d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='794999b0cd7b4ae892cffe77c0f269d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:46Z,use_quota=True,user_id='0b0fc7659e3f4c13ba2ad1170910d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Creating volume ab42b618-4a72-49ab-aa54-a43a51e469d2 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:46 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:46 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 1073741824 Sep 25 16:11:46 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:47 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 1073741824" returned: 0 in 0.959s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:47 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 Sep 25 16:11:47 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:48 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2" returned: 0 in 0.571s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9feeb46a-eb30-4c21-8a39-8b25b017e477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab42b618-4a72-49ab-aa54-a43a51e469d2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a9f41-b41e-4b56-97c1-d5e398d0fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Volume volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 (ab42b618-4a72-49ab-aa54-a43a51e469d2): created successfully Sep 25 16:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a9f41-b41e-4b56-97c1-d5e398d0fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Flow 'volume_create_manager' (be712fa2-5f67-4940-a67e-e274a873aa97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6a1ac841-5997-4dcd-959d-c12c99a4ca21 tempest-VolumesListTestJSON-1675334985 None] Created volume successfully. Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Flow 'volume_create_manager' (d80a6c03-2c11-4cf3-a088-c0714ecd1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6cf870-b305-4879-a8f0-0baa5eee763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6cf870-b305-4879-a8f0-0baa5eee763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-467752031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944314aa-6201-4b98-9e60-08dbf5503666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='794999b0cd7b4ae892cffe77c0f269d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:49Z,use_quota=True,user_id='0b0fc7659e3f4c13ba2ad1170910d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11462bb5-dced-4a78-bac4-16b3aec70941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11462bb5-dced-4a78-bac4-16b3aec70941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af4481b-373d-49d2-bf3b-6eacdae622f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af4481b-373d-49d2-bf3b-6eacdae622f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944314aa-6201-4b98-9e60-08dbf5503666', 'volume_name': 'volume-944314aa-6201-4b98-9e60-08dbf5503666', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a573af87-546b-4fac-96dc-bf422c467b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a573af87-546b-4fac-96dc-bf422c467b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792a4298-69c7-4c2b-86e9-fb1b685d8a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:49 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Volume 944314aa-6201-4b98-9e60-08dbf5503666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944314aa-6201-4b98-9e60-08dbf5503666', 'volume_size': 1} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-467752031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944314aa-6201-4b98-9e60-08dbf5503666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='794999b0cd7b4ae892cffe77c0f269d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:49Z,use_quota=True,user_id='0b0fc7659e3f4c13ba2ad1170910d8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Creating volume 944314aa-6201-4b98-9e60-08dbf5503666 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:49 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:49 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666 1073741824 Sep 25 16:11:49 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:50 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666 1073741824" returned: 0 in 0.684s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:50 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666 Sep 25 16:11:50 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:50 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666" returned: 0 in 0.310s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792a4298-69c7-4c2b-86e9-fb1b685d8a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944314aa-6201-4b98-9e60-08dbf5503666', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68983965-1731-4c9c-8de8-8185a48a5013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Volume volume-944314aa-6201-4b98-9e60-08dbf5503666 (944314aa-6201-4b98-9e60-08dbf5503666): created successfully Sep 25 16:11:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68983965-1731-4c9c-8de8-8185a48a5013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Flow 'volume_create_manager' (d80a6c03-2c11-4cf3-a088-c0714ecd1486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-83cc1413-ee40-4639-86b9-0d90927878dc tempest-VolumesListTestJSON-1675334985 None] Created volume successfully. Sep 25 16:11:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "cinder-944314aa-6201-4b98-9e60-08dbf5503666-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-944314aa-6201-4b98-9e60-08dbf5503666-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "cinder-quobyte-944314aa-6201-4b98-9e60-08dbf5503666" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-quobyte-944314aa-6201-4b98-9e60-08dbf5503666" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d21f68-12a3-4e7f-82f6-11bc8e13e861]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:55 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666 Sep 25 16:11:55 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:56 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666" returned: 0 in 1.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:56 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666 Sep 25 16:11:56 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:56 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-944314aa-6201-4b98-9e60-08dbf5503666" returned: 0 in 0.607s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-quobyte-944314aa-6201-4b98-9e60-08dbf5503666" released by "delete_volume" :: held 1.946s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Created reservations ['56169a1d-8c95-4bdb-9434-5ae4fc675b16', '3c583ebc-bef9-466f-8fe4-d69051c1ed98', '50662ff8-0f4a-4e23-bd01-8f7ce091dfbd', '2a64c511-a50d-4ca9-a41a-c7ab394beaa0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:57 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:57 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "cinder-ab42b618-4a72-49ab-aa54-a43a51e469d2-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-ab42b618-4a72-49ab-aa54-a43a51e469d2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "cinder-quobyte-ab42b618-4a72-49ab-aa54-a43a51e469d2" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-quobyte-ab42b618-4a72-49ab-aa54-a43a51e469d2" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc28814-4cc2-4d65-8d91-c6e6a6cfb1e7]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:57 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.621s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Deleted volume successfully. Sep 25 16:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7338618f-269c-43e4-9d7f-935ef6349564 tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-944314aa-6201-4b98-9e60-08dbf5503666-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:58 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 Sep 25 16:11:58 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:58 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2" returned: 0 in 0.799s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:58 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:58 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:58 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2 Sep 25 16:11:58 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:59 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.585s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:11:59 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ab42b618-4a72-49ab-aa54-a43a51e469d2" returned: 0 in 0.654s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-quobyte-ab42b618-4a72-49ab-aa54-a43a51e469d2" released by "delete_volume" :: held 1.553s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Created reservations ['ef06ca7c-1372-4132-9286-1cc4eef7b721', '713d5b48-0b58-4389-a5ac-96de601a9eea', 'a76f4366-2904-4b19-89c4-90314cafafcb', 'fef14eea-5bd3-4ae9-a9ca-5853949a1376'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:59 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:11:59 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:00 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.799s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:00 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Deleted volume successfully. Sep 25 16:12:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "cinder-bfe2c75f-3e93-4c06-aed6-a20af99d4513-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-bfe2c75f-3e93-4c06-aed6-a20af99d4513-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68f76feb-2b4f-4c17-b8d4-db7fb32703a2 tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-ab42b618-4a72-49ab-aa54-a43a51e469d2-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "cinder-quobyte-bfe2c75f-3e93-4c06-aed6-a20af99d4513" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-quobyte-bfe2c75f-3e93-4c06-aed6-a20af99d4513" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:00 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[46011651-2326-4a28-8e1d-b0266a80a5a4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:00 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 Sep 25 16:12:00 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:01 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513" returned: 0 in 0.866s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:01 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513 Sep 25 16:12:01 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:02 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bfe2c75f-3e93-4c06-aed6-a20af99d4513" returned: 0 in 0.899s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-quobyte-bfe2c75f-3e93-4c06-aed6-a20af99d4513" released by "delete_volume" :: held 1.877s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:INSERT=34,cinder:SELECT=99,cinder:UPDATE=126,cinder:DELETE=15 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Created reservations ['37632160-60b4-4fa1-b9a9-f06b5df18386', 'e598db3f-bb31-460a-b3d5-9631b7248454', '5fd6c4c1-6149-4cdd-a047-2825e2b1c1a2', '99421981-54af-4fb3-a075-18272f07e8ba'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:02 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:12:02 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:03 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:03 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Deleted volume successfully. Sep 25 16:12:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d349df60-fce3-4cd4-bcfc-3db3173e234a tempest-VolumesListTestJSON-1675334985 None] Lock "cinder-bfe2c75f-3e93-4c06-aed6-a20af99d4513-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-602faea7-0342-40d1-8835-d2be7ff4c26d tempest-VolumesActionsTest-911988422 None] Acquiring lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477" by "attach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-602faea7-0342-40d1-8835-d2be7ff4c26d tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477" acquired by "attach_volume" :: waited 0.061s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-602faea7-0342-40d1-8835-d2be7ff4c26d tempest-VolumesActionsTest-911988422 None] Attaching volume 950e238a-868c-4b39-b868-bff3b2a63477 to instance b8abd77c-e143-4599-83f6-a72b136ae113 at mountpoint /dev/vdb on host None. Sep 25 16:12:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-602faea7-0342-40d1-8835-d2be7ff4c26d tempest-VolumesActionsTest-911988422 None] Attach volume completed successfully. Sep 25 16:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-602faea7-0342-40d1-8835-d2be7ff4c26d tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477" released by "attach_volume" :: held 0.201s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-96505ead-944b-464d-8731-eeafc1d69b61 tempest-VolumesActionsTest-911988422 None] Acquiring lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477-detach_volume" by "detach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-96505ead-944b-464d-8731-eeafc1d69b61 tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-96505ead-944b-464d-8731-eeafc1d69b61 tempest-VolumesActionsTest-911988422 None] Detaching volume 950e238a-868c-4b39-b868-bff3b2a63477 from instance b8abd77c-e143-4599-83f6-a72b136ae113. Sep 25 16:12:04 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=111,cinder:INSERT=43,cinder:UPDATE=159,cinder:DELETE=9 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-96505ead-944b-464d-8731-eeafc1d69b61 tempest-VolumesActionsTest-911988422 None] Detach volume completed successfully. Sep 25 16:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-96505ead-944b-464d-8731-eeafc1d69b61 tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477-detach_volume" released by "detach_volume" :: held 0.185s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:12:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Flow 'volume_create_manager' (aad69318-0840-440a-ba93-85f7d280d592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5926d68-8e58-4acb-88c2-fd74095a0bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5926d68-8e58-4acb-88c2-fd74095a0bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-119486194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c782941-cc0c-4bfd-b93e-eda4a6c54f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bffdecb8a04f4b91b3d5921eb06d186d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:07Z,use_quota=True,user_id='4e6429a0885244ab81754f8029ebb203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fa2e3d-1411-41df-a56d-2a02612c3341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fa2e3d-1411-41df-a56d-2a02612c3341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d77034-a82c-4fc0-b673-191138857149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:07 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d77034-a82c-4fc0-b673-191138857149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c782941-cc0c-4bfd-b93e-eda4a6c54f5d', 'volume_name': 'volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54309917-a471-4532-be1e-6d413bcd43f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54309917-a471-4532-be1e-6d413bcd43f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd09e20-c0b1-4eff-a51a-555860a8008a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Volume 9c782941-cc0c-4bfd-b93e-eda4a6c54f5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Trying to clone 9c782941-cc0c-4bfd-b93e-eda4a6c54f5d from image 0d17311a-0d04-4242-8696-17a222efd8fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:12:08 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:12:08 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:12:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a339b45f-de0f-4c97-9eb1-aad8b80e483e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:09 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD Sep 25 16:12:09 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:09 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:09 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa is fetched for user 4e6429a0885244ab81754f8029ebb203. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:12:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b904ddd2-9a09-4f54-9f97-3d08b13037ca]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:09 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD Sep 25 16:12:09 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:10 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD" returned: 0 in 0.678s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-119486194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c782941-cc0c-4bfd-b93e-eda4a6c54f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bffdecb8a04f4b91b3d5921eb06d186d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:07Z,use_quota=True,user_id='4e6429a0885244ab81754f8029ebb203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Creating volume 9c782941-cc0c-4bfd-b93e-eda4a6c54f5d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:12:10 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:10 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d 1073741824 Sep 25 16:12:10 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:11 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d 1073741824" returned: 0 in 0.907s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Flow 'volume_create_manager' (01a69626-fd57-40ea-9c9d-36586a3c4fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee24d4de-8f66-487d-ab76-5e90968e04d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee24d4de-8f66-487d-ab76-5e90968e04d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-380557661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c467cf1-082f-4c14-a9fb-a97aa4821e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d553b9b5f5a4b4b8690f563312b4748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:11Z,use_quota=True,user_id='d2b815b38fd148e7bee72c25d814b650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfa4afc-800d-4707-8d2f-a2d933cca99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfa4afc-800d-4707-8d2f-a2d933cca99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1b2fc1-175d-47a9-bc2e-72d4b84d3899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1b2fc1-175d-47a9-bc2e-72d4b84d3899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c467cf1-082f-4c14-a9fb-a97aa4821e19', 'volume_name': 'volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73da8ccd-e9b2-43ee-b5db-f5e38a7030f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73da8ccd-e9b2-43ee-b5db-f5e38a7030f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d20c827-dae4-4bee-b930-5e9813e00bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Volume 3c467cf1-082f-4c14-a9fb-a97aa4821e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19', 'volume_size': 1} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:11 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d Sep 25 16:12:11 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:11 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d" returned: 0 in 0.377s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-380557661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c467cf1-082f-4c14-a9fb-a97aa4821e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d553b9b5f5a4b4b8690f563312b4748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:11Z,use_quota=True,user_id='d2b815b38fd148e7bee72c25d814b650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Creating volume 3c467cf1-082f-4c14-a9fb-a97aa4821e19 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:12:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:12 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 1073741824 Sep 25 16:12:12 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:12 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Attempting download of 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume 9c782941-cc0c-4bfd-b93e-eda4a6c54f5d. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:12:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5527baca-3830-4cd1-928e-d91253848e98]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_7xxqgo1i {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:12 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_7xxqgo1i Sep 25 16:12:12 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:12 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 1073741824" returned: 0 in 0.846s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:12 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_7xxqgo1i" returned: 0 in 0.575s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_7xxqgo1i {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:12 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 Sep 25 16:12:12 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:13 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_7xxqgo1i Sep 25 16:12:13 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:13 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19" returned: 0 in 0.470s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d20c827-dae4-4bee-b930-5e9813e00bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0020ab12-02fb-454b-85d7-de5f9b84cfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:13 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Volume volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 (3c467cf1-082f-4c14-a9fb-a97aa4821e19): created successfully Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0020ab12-02fb-454b-85d7-de5f9b84cfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Flow 'volume_create_manager' (01a69626-fd57-40ea-9c9d-36586a3c4fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_7xxqgo1i" returned: 1 in 0.630s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_7xxqgo1i' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a86001-abd4-45e2-b54a-817eedbb9ae9]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c3cdc097-0dce-4720-8fe4-bb89680ee5fd tempest-VolumesNegativeTest-1246319298 None] Created volume successfully. Sep 25 16:12:13 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD Sep 25 16:12:13 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:14 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:14 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87314) copy_or_move_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1011}} Sep 25 16:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d iflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:14 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d iflag=direct Sep 25 16:12:14 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:14 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d iflag=direct" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:14 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d oflag=direct Sep 25 16:12:14 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:14 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d oflag=direct" returned: 0 in 0.593s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:14 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:12:14 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:16 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 1.045s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_f3fcvo2bdevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d, size 21.00 MB, duration 1.05 sec {{(pid=87314) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:12:16 devstack cinder-volume[87314]: INFO cinder.volume.volume_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Volume copy 21.00 MB at 20.07 MB/s Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:16 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d 1G Sep 25 16:12:16 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:16 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d 1G" returned: 0 in 0.650s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Downloaded image 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume 9c782941-cc0c-4bfd-b93e-eda4a6c54f5d successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa for user 4e6429a0885244ab81754f8029ebb203 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Marking volume 9c782941-cc0c-4bfd-b93e-eda4a6c54f5d as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Copying metadata from image 0d17311a-0d04-4242-8696-17a222efd8fa to 9c782941-cc0c-4bfd-b93e-eda4a6c54f5d. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Creating volume glance metadata for volume 9c782941-cc0c-4bfd-b93e-eda4a6c54f5d backed by image 0d17311a-0d04-4242-8696-17a222efd8fa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd09e20-c0b1-4eff-a51a-555860a8008a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c833e89b-f557-4600-b805-5842c34c2b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Volume volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d (9c782941-cc0c-4bfd-b93e-eda4a6c54f5d): created successfully Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c833e89b-f557-4600-b805-5842c34c2b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Flow 'volume_create_manager' (aad69318-0840-440a-ba93-85f7d280d592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f170fb49-bb06-462a-93c0-3e9d289e43e4 tempest-VolumesImageMetadata-1179232607 None] Created volume successfully. Sep 25 16:12:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Acquiring lock "cinder-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Lock "cinder-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Acquiring lock "cinder-quobyte-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Lock "cinder-quobyte-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4997f069-2956-4a79-a928-0b8107c21db1]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:18 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d Sep 25 16:12:18 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:19 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d" returned: 0 in 0.761s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:19 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d Sep 25 16:12:19 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:19 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d" returned: 0 in 0.676s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Lock "cinder-quobyte-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d" released by "delete_volume" :: held 1.577s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Created reservations ['e5f46ffd-121a-43d0-8409-a1cbb1f8222b', '5b3d4f28-9c45-43aa-9fc8-925a89a29ec9', '2ba657a6-bc44-49bf-9a04-604ba732ed29', '869a158e-36f5-4e14-8b03-969af44df1c4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:20 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:12:20 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:20 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.518s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Deleted volume successfully. Sep 25 16:12:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-19344fd0-e76b-4754-b96d-6f7845d7764b tempest-VolumesImageMetadata-1179232607 None] Lock "cinder-9c782941-cc0c-4bfd-b93e-eda4a6c54f5d-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9744183a-41e9-4f3a-b6e3-d9fdeb8c496c tempest-VolumesActionsTest-911988422 None] Acquiring lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477" by "attach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9744183a-41e9-4f3a-b6e3-d9fdeb8c496c tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477" acquired by "attach_volume" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9744183a-41e9-4f3a-b6e3-d9fdeb8c496c tempest-VolumesActionsTest-911988422 None] Attaching volume 950e238a-868c-4b39-b868-bff3b2a63477 to instance e51f0d57-2a4a-4d8b-bf11-f4bdd831b5c9 at mountpoint /dev/vdb on host None. Sep 25 16:12:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9744183a-41e9-4f3a-b6e3-d9fdeb8c496c tempest-VolumesActionsTest-911988422 None] Attach volume completed successfully. Sep 25 16:12:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9744183a-41e9-4f3a-b6e3-d9fdeb8c496c tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477" released by "attach_volume" :: held 0.199s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5607ed35-4c0c-4b4e-93f1-ddb0685e0083 tempest-VolumesActionsTest-911988422 None] Acquiring lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477-detach_volume" by "detach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5607ed35-4c0c-4b4e-93f1-ddb0685e0083 tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5607ed35-4c0c-4b4e-93f1-ddb0685e0083 tempest-VolumesActionsTest-911988422 None] Detaching volume 950e238a-868c-4b39-b868-bff3b2a63477 from instance e51f0d57-2a4a-4d8b-bf11-f4bdd831b5c9. Sep 25 16:12:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5607ed35-4c0c-4b4e-93f1-ddb0685e0083 tempest-VolumesActionsTest-911988422 None] Detach volume completed successfully. Sep 25 16:12:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5607ed35-4c0c-4b4e-93f1-ddb0685e0083 tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477-detach_volume" released by "detach_volume" :: held 0.178s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Flow 'volume_create_manager' (4ff965c2-35ae-4428-b7b1-e3efd71975d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9802196-c2f4-4154-9100-cd1795ecbee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9802196-c2f4-4154-9100-cd1795ecbee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-254751094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdac5f6f-025c-476d-abe8-1b6a59fd9682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457f2f7d7e8a41e4b48ab37941a546ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:33Z,use_quota=True,user_id='54dd97cbba244e47bb505063cf691fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01ebc1d-149e-4d85-a5b2-a8027d16750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01ebc1d-149e-4d85-a5b2-a8027d16750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d90dae-e587-46d8-803b-3d3b6d08cab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d90dae-e587-46d8-803b-3d3b6d08cab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdac5f6f-025c-476d-abe8-1b6a59fd9682', 'volume_name': 'volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4ce379-1a42-4d05-9d98-f40b83173f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4ce379-1a42-4d05-9d98-f40b83173f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c426a4-f1e8-4027-aded-e00806cdfef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Volume bdac5f6f-025c-476d-abe8-1b6a59fd9682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682', 'volume_size': 1} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-254751094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdac5f6f-025c-476d-abe8-1b6a59fd9682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457f2f7d7e8a41e4b48ab37941a546ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:33Z,use_quota=True,user_id='54dd97cbba244e47bb505063cf691fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Creating volume bdac5f6f-025c-476d-abe8-1b6a59fd9682 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:12:32 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:32 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 1073741824 Sep 25 16:12:32 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:33 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 1073741824" returned: 0 in 0.785s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:33 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 Sep 25 16:12:33 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:34 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682" returned: 0 in 0.519s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:12:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c426a4-f1e8-4027-aded-e00806cdfef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f19d659-2694-4b83-8591-44f69208579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Volume volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 (bdac5f6f-025c-476d-abe8-1b6a59fd9682): created successfully Sep 25 16:12:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f19d659-2694-4b83-8591-44f69208579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Flow 'volume_create_manager' (4ff965c2-35ae-4428-b7b1-e3efd71975d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e3e7128b-748f-4d32-bf5d-cda4bdacb0ec tempest-AttachVolumeTestJSON-1174005684 None] Created volume successfully. Sep 25 16:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-324231fd-e1ac-492b-b38a-adc097dde8af req-0ce39bc4-4b85-46cc-9939-135fc1f8be3d tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-324231fd-e1ac-492b-b38a-adc097dde8af req-0ce39bc4-4b85-46cc-9939-135fc1f8be3d tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-324231fd-e1ac-492b-b38a-adc097dde8af req-0ce39bc4-4b85-46cc-9939-135fc1f8be3d tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-324231fd-e1ac-492b-b38a-adc097dde8af req-0ce39bc4-4b85-46cc-9939-135fc1f8be3d tempest-AttachVolumeTestJSON-1174005684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9de01a6-3175-4607-bd96-4fe2e57f393b', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[753608db-91f6-40e7-8230-c96e3f46063d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-324231fd-e1ac-492b-b38a-adc097dde8af req-0ce39bc4-4b85-46cc-9939-135fc1f8be3d tempest-AttachVolumeTestJSON-1174005684 None] attachment_update completed successfully. Sep 25 16:12:36 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 Sep 25 16:12:36 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:37 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477" returned: 0 in 0.668s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[16887ee5-7d3f-496b-9ad1-2f657bfa0cbf]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:37 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 Sep 25 16:12:37 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:37 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477" returned: 0 in 0.653s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.110ed75c-d883-4387-9598-e34a298e6dc6w7qyi0j3.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:37 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.110ed75c-d883-4387-9598-e34a298e6dc6w7qyi0j3.img Sep 25 16:12:37 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Flow 'volume_create_manager' (ccf0c321-2a94-4e5e-ad3b-9fb8377094c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cfcdbc-096a-4a0c-85d5-bc7352e66d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cfcdbc-096a-4a0c-85d5-bc7352e66d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1652991921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270dffafb7ea4f4fbefb093a7a7c6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:39Z,use_quota=True,user_id='18b8db54809948969c39487e90aed19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea63b3de-b44b-4c7f-b4dc-3b3dd99ffee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea63b3de-b44b-4c7f-b4dc-3b3dd99ffee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca490be-4839-427e-b6f9-11bfa8f47b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca490be-4839-427e-b6f9-11bfa8f47b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19', 'volume_name': 'volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f751eb-d3f2-4c96-8ae9-34881ffce9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f751eb-d3f2-4c96-8ae9-34881ffce9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ebd785-55e5-4a65-a2f1-a677280e14a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Volume 9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19', 'volume_size': 1} Sep 25 16:12:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:46 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=35,cinder:UPDATE=24,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:46 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.110ed75c-d883-4387-9598-e34a298e6dc6w7qyi0j3.img" returned: 0 in 9.228s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[24edb3f0-de95-40af-a09a-d47deeb580ad]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:47 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 Sep 25 16:12:47 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:47 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477" returned: 0 in 0.814s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:47 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477, size 1024.00 MB, duration 9.23 sec, destination /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.110ed75c-d883-4387-9598-e34a298e6dc6w7qyi0j3.img {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:12:47 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Converted 1024.00 MB image at 110.96 MB/s Sep 25 16:12:47 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] 110ed75c-d883-4387-9598-e34a298e6dc6 was raw, no need to convert to raw {{(pid=87314) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1189}} Sep 25 16:12:49 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=34,cinder:SELECT=38,cinder:DELETE=3,cinder:INSERT=15 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Acquiring lock "cinder-3c467cf1-082f-4c14-a9fb-a97aa4821e19-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Lock "cinder-3c467cf1-082f-4c14-a9fb-a97aa4821e19-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Acquiring lock "cinder-quobyte-3c467cf1-082f-4c14-a9fb-a97aa4821e19" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Lock "cinder-quobyte-3c467cf1-082f-4c14-a9fb-a97aa4821e19" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87cf8b4-2929-4c30-8efb-c0ca878250a7]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:50 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 Sep 25 16:12:50 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:50 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19" returned: 0 in 0.480s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:50 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19 Sep 25 16:12:50 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:50 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3c467cf1-082f-4c14-a9fb-a97aa4821e19" returned: 0 in 0.327s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Lock "cinder-quobyte-3c467cf1-082f-4c14-a9fb-a97aa4821e19" released by "delete_volume" :: held 0.909s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Created reservations ['9df41445-277d-43c0-bb1c-728a0ec659d0', 'eb2c50ed-b8d9-4158-8ef4-8ce76d33d936', '8f9d4fab-af4a-4978-92a2-24474c758580', '929dc21a-4508-43f2-a269-58afcf4bf83e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:51 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:12:51 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:51 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.421s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Deleted volume successfully. Sep 25 16:12:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4273f5c3-730f-4c87-afc6-68f5d9f5c46b tempest-VolumesNegativeTest-1246319298 None] Lock "cinder-3c467cf1-082f-4c14-a9fb-a97aa4821e19-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:12:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:12:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:13:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-2bc519be-26ba-427d-9977-4ea2c6996f17 req-7de0f5bd-a1a4-4332-9e6c-43e613b666ed tempest-AttachVolumeTestJSON-1174005684 None] Terminate volume connection completed successfully. Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2bc519be-26ba-427d-9977-4ea2c6996f17 req-7de0f5bd-a1a4-4332-9e6c-43e613b666ed tempest-AttachVolumeTestJSON-1174005684 None] Deleting attachment d9de01a6-3175-4607-bd96-4fe2e57f393b. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.356s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Uploaded volume to glance image-id: 110ed75c-d883-4387-9598-e34a298e6dc6. {{(pid=87314) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 35.979s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1652991921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270dffafb7ea4f4fbefb093a7a7c6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:39Z,use_quota=True,user_id='18b8db54809948969c39487e90aed19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Creating volume 9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:15 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:13:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-86968654-1623-4ea6-a5e1-e13818687fa0 tempest-VolumesActionsTest-911988422 None] Copy volume to image completed successfully. Sep 25 16:13:15 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 1073741824 Sep 25 16:13:15 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:16 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 1073741824" returned: 0 in 0.804s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:16 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 Sep 25 16:13:16 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:16 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ebd785-55e5-4a65-a2f1-a677280e14a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b026778d-ba4f-4d91-92bc-029e93b45147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Volume volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 (9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19): created successfully Sep 25 16:13:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b026778d-ba4f-4d91-92bc-029e93b45147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Flow 'volume_create_manager' (ccf0c321-2a94-4e5e-ad3b-9fb8377094c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0fcbf7a2-86e9-4b95-862e-10fb72b7b069 tempest-VolumesTransfersTest-1376045934 None] Created volume successfully. Sep 25 16:13:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[609944c1-43b6-4f34-a4c9-153710608e69]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:17 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 Sep 25 16:13:17 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:17 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477" returned: 0 in 0.471s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf1c531-fd77-4691-b7bb-f4b0b1eddc2f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:17 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 Sep 25 16:13:17 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:18 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477" returned: 0 in 0.563s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:18 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img Sep 25 16:13:18 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0ea7c5ab-ccd5-4b81-a0ab-176f6994b608 tempest-VolumesTransfersTest-1541811340 None] Transfer volume completed successfully. Sep 25 16:13:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Acquiring lock "cinder-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Lock "cinder-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Acquiring lock "cinder-quobyte-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Lock "cinder-quobyte-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb9076e-c389-41c7-ae7b-45ffe24e6dd1]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:22 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 Sep 25 16:13:22 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:23 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19" returned: 0 in 1.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:23 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19 Sep 25 16:13:23 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:24 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19" returned: 0 in 0.746s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Lock "cinder-quobyte-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19" released by "delete_volume" :: held 2.220s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:24 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Created reservations ['08a69feb-70d6-4c00-b85e-8536fe8c282b', '178c69b3-6739-4401-8728-371aaffebfe4', 'a8a85094-2868-4354-a359-28b0cb98035c', '76650803-1195-485a-8437-0e71285768c7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:13:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:25 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:13:25 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:26 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.849s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:26 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Deleted volume successfully. Sep 25 16:13:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-10eadd64-6ac3-4583-8505-3de28fd985c3 tempest-VolumesTransfersTest-1848042366 None] Lock "cinder-9a7c8b63-c775-4c4e-90cf-9f3b03b8bc19-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Flow 'volume_create_manager' (e066408e-725a-4efc-b433-4f9f23e5e492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617b975f-059c-4943-add0-a4015f618ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617b975f-059c-4943-add0-a4015f618ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-747866049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66474d5a-e410-4c9d-8a60-07dde60d7561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270dffafb7ea4f4fbefb093a7a7c6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:27Z,use_quota=True,user_id='18b8db54809948969c39487e90aed19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07bfa19-e1c1-4cf5-bde5-7de5862fa114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07bfa19-e1c1-4cf5-bde5-7de5862fa114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fdffe7-d3ab-4ba8-9fb7-0105db03b50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fdffe7-d3ab-4ba8-9fb7-0105db03b50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66474d5a-e410-4c9d-8a60-07dde60d7561', 'volume_name': 'volume-66474d5a-e410-4c9d-8a60-07dde60d7561', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3ede56-cb8d-409a-8dd0-7d3719314f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3ede56-cb8d-409a-8dd0-7d3719314f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26b8c18-1853-46eb-938b-281b800cf1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Volume 66474d5a-e410-4c9d-8a60-07dde60d7561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66474d5a-e410-4c9d-8a60-07dde60d7561', 'volume_size': 1} Sep 25 16:13:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:31 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img" returned: 0 in 12.833s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9461edb-90ac-4f8b-906a-9a9cad33a3d7]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:31 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 Sep 25 16:13:31 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:31 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477" returned: 0 in 0.865s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:31 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477, size 1024.00 MB, duration 12.84 sec, destination /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:13:31 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Converted 1024.00 MB image at 79.78 MB/s Sep 25 16:13:32 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] b2fb2d68-92a3-4536-b0db-b79d6104d978 was raw, converting to qcow2 {{(pid=87314) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1206}} Sep 25 16:13:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a1aa6a-7c3b-41d1-9b61-f94eff8a1c7e]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:32 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img Sep 25 16:13:32 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:32 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img" returned: 0 in 0.552s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:32 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img Sep 25 16:13:32 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:33 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img" returned: 1 in 0.494s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:13:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img /opt/stack/data/cinder/conversion/vol_upload_airyt62r {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:33 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img /opt/stack/data/cinder/conversion/vol_upload_airyt62r Sep 25 16:13:33 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:33 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img /opt/stack/data/cinder/conversion/vol_upload_airyt62r" returned: 0 in 0.361s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:33 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Image conversion details: src /opt/stack/data/cinder/conversion/950e238a-868c-4b39-b868-bff3b2a63477.temp_image.b2fb2d68-92a3-4536-b0db-b79d6104d978ajznoozm.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_airyt62r {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:13:33 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 16:13:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc0a74d-5c2b-4b5e-bebc-fe4a8e18306a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_airyt62r {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:33 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_airyt62r Sep 25 16:13:33 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:33 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_airyt62r" returned: 0 in 0.412s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 18.830s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Uploaded volume to glance image-id: b2fb2d68-92a3-4536-b0db-b79d6104d978. {{(pid=87314) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.402s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-747866049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66474d5a-e410-4c9d-8a60-07dde60d7561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270dffafb7ea4f4fbefb093a7a7c6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:27Z,use_quota=True,user_id='18b8db54809948969c39487e90aed19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Creating volume 66474d5a-e410-4c9d-8a60-07dde60d7561 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dcd47712-046e-4dd5-aa7e-af0245aca2ad tempest-VolumesActionsTest-911988422 None] Copy volume to image completed successfully. Sep 25 16:13:36 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561 1073741824 Sep 25 16:13:36 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:36 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561 1073741824" returned: 0 in 0.578s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:36 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561 Sep 25 16:13:36 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:37 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26b8c18-1853-46eb-938b-281b800cf1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66474d5a-e410-4c9d-8a60-07dde60d7561', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6c5fe6-56ee-4e71-aaf2-2b8ad2081823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Volume volume-66474d5a-e410-4c9d-8a60-07dde60d7561 (66474d5a-e410-4c9d-8a60-07dde60d7561): created successfully Sep 25 16:13:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6c5fe6-56ee-4e71-aaf2-2b8ad2081823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Flow 'volume_create_manager' (e066408e-725a-4efc-b433-4f9f23e5e492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0a6f5588-bb3e-45da-bf8e-8e5b24de1dd2 tempest-VolumesTransfersTest-1376045934 None] Created volume successfully. Sep 25 16:13:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Acquiring lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Acquiring lock "cinder-quobyte-950e238a-868c-4b39-b868-bff3b2a63477" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Lock "cinder-quobyte-950e238a-868c-4b39-b868-bff3b2a63477" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a39805-c059-4c87-af9d-22df23016918]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Acquiring lock "cinder-66474d5a-e410-4c9d-8a60-07dde60d7561-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Lock "cinder-66474d5a-e410-4c9d-8a60-07dde60d7561-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Acquiring lock "cinder-quobyte-66474d5a-e410-4c9d-8a60-07dde60d7561" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Lock "cinder-quobyte-66474d5a-e410-4c9d-8a60-07dde60d7561" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:38 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 Sep 25 16:13:38 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[578cd7da-9fe8-4bb7-b207-224a6e4bb622]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:13:38 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561 Sep 25 16:13:38 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Flow 'volume_create_manager' (0fe62f26-67a7-4137-9e72-eb0ecc2e4191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8394e6-1432-4cfa-8a3c-2cd096e305d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8394e6-1432-4cfa-8a3c-2cd096e305d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-899037482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdeed20-0dfd-4f1e-b953-5399b42a1f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d949ebbc662c47edbdfb7bda7a621273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:38Z,use_quota=True,user_id='4b03a06df5f746a8b80891ced97ba806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534ac8f2-9cbb-4109-b451-860a56a1f24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534ac8f2-9cbb-4109-b451-860a56a1f24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42af109-586c-4cb5-9e36-9b5fe1908c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:13:38 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477" returned: 0 in 0.653s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:38 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477 Sep 25 16:13:38 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:38 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561" returned: 0 in 0.609s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:38 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561 Sep 25 16:13:38 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:39 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-950e238a-868c-4b39-b868-bff3b2a63477" returned: 0 in 0.407s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42af109-586c-4cb5-9e36-9b5fe1908c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3bdeed20-0dfd-4f1e-b953-5399b42a1f8e', 'volume_name': 'volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cb4942-69d8-4929-8344-f27c1e66afa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cb4942-69d8-4929-8344-f27c1e66afa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a284f3e-c845-4ece-bd31-60721a2b0f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Volume 3bdeed20-0dfd-4f1e-b953-5399b42a1f8e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Trying to clone 3bdeed20-0dfd-4f1e-b953-5399b42a1f8e from image 0d17311a-0d04-4242-8696-17a222efd8fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Lock "cinder-quobyte-950e238a-868c-4b39-b868-bff3b2a63477" released by "delete_volume" :: held 1.174s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Created reservations ['6305b978-2dc8-485c-b302-02b6b26e2944', '9977b059-9792-4290-9c7c-21b603fd9785', '8de64b30-c933-47c8-9fd7-317aa8cb7d4c', '06d8940b-4112-41f2-ac29-6ff408fb915a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:13:39 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-66474d5a-e410-4c9d-8a60-07dde60d7561" returned: 0 in 0.417s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Lock "cinder-quobyte-66474d5a-e410-4c9d-8a60-07dde60d7561" released by "delete_volume" :: held 1.145s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:39 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:13:39 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Created reservations ['171e17ed-cac5-448e-bfd7-e6dbddd15998', '4312f51c-f60d-4c0d-8793-4ce539746b3a', 'a2d3846c-32b7-4603-be44-730735fbb72f', '7d8dfe06-6c03-4e01-b7fc-d52d1a3574e4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:13:39 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c27dd07-daa6-4631-92ce-d76952ac8eae]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:39 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:13:39 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:39 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Deleted volume successfully. Sep 25 16:13:39 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD Sep 25 16:13:39 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a58879d-d896-40de-8338-640398340176 tempest-VolumesActionsTest-911988422 None] Lock "cinder-950e238a-868c-4b39-b868-bff3b2a63477-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:40 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.317s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Deleted volume successfully. Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84606129-f4ab-436f-9043-db39578dc0ed tempest-VolumesTransfersTest-1848042366 None] Lock "cinder-66474d5a-e410-4c9d-8a60-07dde60d7561-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:40 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa is fetched for user 4b03a06df5f746a8b80891ced97ba806. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f678da77-e1ef-4f4d-b73e-65ec98a89683]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:40 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD Sep 25 16:13:40 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:40 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-899037482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdeed20-0dfd-4f1e-b953-5399b42a1f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d949ebbc662c47edbdfb7bda7a621273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:38Z,use_quota=True,user_id='4b03a06df5f746a8b80891ced97ba806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Creating volume 3bdeed20-0dfd-4f1e-b953-5399b42a1f8e {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:40 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:13:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:40 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e 1073741824 Sep 25 16:13:40 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:41 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e 1073741824" returned: 0 in 0.640s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:41 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e Sep 25 16:13:41 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:41 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e" returned: 0 in 0.306s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:42 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Attempting download of 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume 3bdeed20-0dfd-4f1e-b953-5399b42a1f8e. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:13:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb48ea-c7ff-4409-b544-4faabd970a48]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_29nlcf9g {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:42 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_29nlcf9g Sep 25 16:13:42 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:42 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_29nlcf9g" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_29nlcf9g {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:42 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_29nlcf9g Sep 25 16:13:42 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:42 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_29nlcf9g" returned: 1 in 0.420s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_29nlcf9g' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:13:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1223bf-8a7c-4410-badf-838cdffda5f6]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:43 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD Sep 25 16:13:43 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:43 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:43 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87314) copy_or_move_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1011}} Sep 25 16:13:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e iflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:43 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e iflag=direct Sep 25 16:13:43 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:43 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e iflag=direct" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:43 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e oflag=direct Sep 25 16:13:43 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:44 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e oflag=direct" returned: 0 in 0.465s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:44 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:13:44 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:45 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 0.895s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_ojmji3tudevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e, size 21.00 MB, duration 1.00 sec {{(pid=87314) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:13:45 devstack cinder-volume[87314]: INFO cinder.volume.volume_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Volume copy 21.00 MB at 21.00 MB/s Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:45 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e 1G Sep 25 16:13:45 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:45 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e 1G" returned: 0 in 0.528s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Downloaded image 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume 3bdeed20-0dfd-4f1e-b953-5399b42a1f8e successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa for user 4b03a06df5f746a8b80891ced97ba806 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Marking volume 3bdeed20-0dfd-4f1e-b953-5399b42a1f8e as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Copying metadata from image 0d17311a-0d04-4242-8696-17a222efd8fa to 3bdeed20-0dfd-4f1e-b953-5399b42a1f8e. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Creating volume glance metadata for volume 3bdeed20-0dfd-4f1e-b953-5399b42a1f8e backed by image 0d17311a-0d04-4242-8696-17a222efd8fa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a284f3e-c845-4ece-bd31-60721a2b0f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b4f60f-002d-4e50-a37f-ec8bb55f3c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Volume volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e (3bdeed20-0dfd-4f1e-b953-5399b42a1f8e): created successfully Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b4f60f-002d-4e50-a37f-ec8bb55f3c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Flow 'volume_create_manager' (0fe62f26-67a7-4137-9e72-eb0ecc2e4191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5b94a69e-303a-4cc7-a559-2045e6b8f005 tempest-TestShelveInstance-1299164924 None] Created volume successfully. Sep 25 16:13:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-871c768c-edf9-4630-a06b-f728a8a36b4d req-4a6f1499-42da-45a3-a232-1cf3204c0422 tempest-TestShelveInstance-1299164924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-871c768c-edf9-4630-a06b-f728a8a36b4d req-4a6f1499-42da-45a3-a232-1cf3204c0422 tempest-TestShelveInstance-1299164924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-871c768c-edf9-4630-a06b-f728a8a36b4d req-4a6f1499-42da-45a3-a232-1cf3204c0422 tempest-TestShelveInstance-1299164924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-871c768c-edf9-4630-a06b-f728a8a36b4d req-4a6f1499-42da-45a3-a232-1cf3204c0422 tempest-TestShelveInstance-1299164924 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea8bbcb3-b698-4a9e-8fcb-7e6a5be3643e', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:13:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-871c768c-edf9-4630-a06b-f728a8a36b4d req-4a6f1499-42da-45a3-a232-1cf3204c0422 tempest-TestShelveInstance-1299164924 None] attachment_update completed successfully. Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (eafcb1b0-d734-42fa-8f02-0a8663509aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36aac6ea-0ecf-4a9a-b622-9ea34d1350a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36aac6ea-0ecf-4a9a-b622-9ea34d1350a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-626141160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8378e32-0a43-4a13-a853-065369dbc307,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:52Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3800de9a-622e-45ed-9fc0-1438e3c68c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3800de9a-622e-45ed-9fc0-1438e3c68c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd2a4fb-f61b-403c-a24d-e81b23a100ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd2a4fb-f61b-403c-a24d-e81b23a100ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8378e32-0a43-4a13-a853-065369dbc307', 'volume_name': 'volume-d8378e32-0a43-4a13-a853-065369dbc307', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e65ae0-49e3-42ec-b87f-4c35d4c7b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e65ae0-49e3-42ec-b87f-4c35d4c7b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93d27e7-11a8-422a-9669-a19d7d1e5e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Volume d8378e32-0a43-4a13-a853-065369dbc307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8378e32-0a43-4a13-a853-065369dbc307', 'volume_size': 1} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-626141160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8378e32-0a43-4a13-a853-065369dbc307,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:52Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Creating volume d8378e32-0a43-4a13-a853-065369dbc307 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:52 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:13:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:52 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307 1073741824 Sep 25 16:13:52 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:53 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307 1073741824" returned: 0 in 0.638s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:53 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307 Sep 25 16:13:53 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:53 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93d27e7-11a8-422a-9669-a19d7d1e5e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8378e32-0a43-4a13-a853-065369dbc307', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f2dd93-3935-4e4d-a181-f94ab84db638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:53 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Volume volume-d8378e32-0a43-4a13-a853-065369dbc307 (d8378e32-0a43-4a13-a853-065369dbc307): created successfully Sep 25 16:13:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f2dd93-3935-4e4d-a181-f94ab84db638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (eafcb1b0-d734-42fa-8f02-0a8663509aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f6c90111-b3aa-4d72-842a-8ff780a60a41 tempest-VolumesGetTest-530087925 None] Created volume successfully. Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Flow 'volume_create_manager' (89328e3f-88a7-41f7-9c94-76959ad36fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b2048-ab00-4914-8d36-9ba9048cf5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b2048-ab00-4914-8d36-9ba9048cf5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1231996056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65f7c98-40f3-420b-beb0-8a8eb7e6abe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6da8941b7e40249944101343747de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:54Z,use_quota=True,user_id='95c52421cdaf4550bb7bee5c6a2a359e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72303527-a546-4eb8-8587-a44fe160b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72303527-a546-4eb8-8587-a44fe160b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9725c5-3071-421a-838e-7cc990e68afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9725c5-3071-421a-838e-7cc990e68afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65f7c98-40f3-420b-beb0-8a8eb7e6abe3', 'volume_name': 'volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a752a14-6a1a-489f-b63b-c29f067dd8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a752a14-6a1a-489f-b63b-c29f067dd8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e68e3b7-ef8c-4697-a730-bd0ffaf17f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Volume e65f7c98-40f3-420b-beb0-8a8eb7e6abe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3', 'volume_size': 1} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1231996056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65f7c98-40f3-420b-beb0-8a8eb7e6abe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6da8941b7e40249944101343747de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:54Z,use_quota=True,user_id='95c52421cdaf4550bb7bee5c6a2a359e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Creating volume e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:54 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:13:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:54 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 1073741824 Sep 25 16:13:54 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:55 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 1073741824" returned: 0 in 1.134s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:55 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 Sep 25 16:13:55 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:55 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3" returned: 0 in 0.580s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e68e3b7-ef8c-4697-a730-bd0ffaf17f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd332ec-d45d-4f04-9dc8-dbcfed8dbf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Volume volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 (e65f7c98-40f3-420b-beb0-8a8eb7e6abe3): created successfully Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd332ec-d45d-4f04-9dc8-dbcfed8dbf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Flow 'volume_create_manager' (89328e3f-88a7-41f7-9c94-76959ad36fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-415bcab8-5ae3-427c-9825-308af0aead62 tempest-VolumesTransfersV357Test-922315547 None] Created volume successfully. Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (94904d20-d7ef-4021-bd13-751bbe21c408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd0b63c-7858-415d-a76d-f24056c78e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd0b63c-7858-415d-a76d-f24056c78e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1851855484',display_name='tempest-VolumesGetTest-Volume-1557456192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc739202-7233-416f-95e8-42d17440aa35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:56Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d922b01-7014-45da-b140-61958381fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d922b01-7014-45da-b140-61958381fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3da5638-7402-4cb5-bc6a-641549b2f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3da5638-7402-4cb5-bc6a-641549b2f333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc739202-7233-416f-95e8-42d17440aa35', 'volume_name': 'volume-fc739202-7233-416f-95e8-42d17440aa35', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f354ac-2bc9-470b-afce-7ef1520dc2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f354ac-2bc9-470b-afce-7ef1520dc2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26516b5a-d461-4726-a898-49e10c3ecba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Volume fc739202-7233-416f-95e8-42d17440aa35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc739202-7233-416f-95e8-42d17440aa35', 'volume_size': 1} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1851855484',display_name='tempest-VolumesGetTest-Volume-1557456192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc739202-7233-416f-95e8-42d17440aa35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:56Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Creating volume fc739202-7233-416f-95e8-42d17440aa35 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:56 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:13:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:56 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35 1073741824 Sep 25 16:13:56 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:57 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35 1073741824" returned: 0 in 0.691s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:57 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35 Sep 25 16:13:57 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b29f5767-609e-4ff5-8f4c-56fb3f58ab93 tempest-VolumesTransfersV357Test-1422402047 None] Transfer volume completed successfully. Sep 25 16:13:57 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35" returned: 0 in 0.547s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26516b5a-d461-4726-a898-49e10c3ecba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc739202-7233-416f-95e8-42d17440aa35', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2fe839-3faf-4a98-9a14-58cc264396d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:57 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Volume volume-fc739202-7233-416f-95e8-42d17440aa35 (fc739202-7233-416f-95e8-42d17440aa35): created successfully Sep 25 16:13:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2fe839-3faf-4a98-9a14-58cc264396d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (94904d20-d7ef-4021-bd13-751bbe21c408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-65220462-e221-4fcb-a20a-5894acba93d8 tempest-VolumesGetTest-530087925 None] Created volume successfully. Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Acquiring lock "cinder-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Lock "cinder-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Acquiring lock "cinder-quobyte-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:58 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:13:58 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Lock "cinder-quobyte-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02d18c6-6edc-4403-ae3e-f1fe3726d5db]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-fc739202-7233-416f-95e8-42d17440aa35-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Lock "cinder-fc739202-7233-416f-95e8-42d17440aa35-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-quobyte-fc739202-7233-416f-95e8-42d17440aa35" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-fc739202-7233-416f-95e8-42d17440aa35" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:59 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.466s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:59 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:13:59 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[381de212-7f5a-447d-b77f-a61e365e0f72]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:59 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35 Sep 25 16:13:59 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:59 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3" returned: 0 in 0.739s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:59 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3 Sep 25 16:13:59 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:59 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35" returned: 0 in 0.611s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:59 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35 Sep 25 16:13:59 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:00 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3" returned: 0 in 0.499s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Lock "cinder-quobyte-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3" released by "delete_volume" :: held 1.372s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Created reservations ['e657c564-fd3b-49a9-aebd-277946315b4b', '512c7999-0e73-4f11-8d61-fc7616a18892', 'fa3a8ede-8088-4e6a-9429-396ca63cafd4', '4303c9ca-53e2-42f9-bc3f-5335ccf43f27'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:00 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fc739202-7233-416f-95e8-42d17440aa35" returned: 0 in 0.465s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-fc739202-7233-416f-95e8-42d17440aa35" released by "delete_volume" :: held 1.174s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Created reservations ['b5c9a873-5f7f-4dd3-9455-911a6ef84711', 'bb1aa4af-163b-4dd1-9a93-be2384c3ffb8', '43f83190-4a63-4847-a115-acc7a49eb2f1', 'acb049f2-6001-4434-9d23-45f655e8a7c3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:00 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:00 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:00 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:00 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:00 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.625s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Deleted volume successfully. Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77251004-831a-4db2-9e7b-aaaedebb81ce tempest-VolumesTransfersV357Test-1994334832 None] Lock "cinder-e65f7c98-40f3-420b-beb0-8a8eb7e6abe3-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:01 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.775s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Deleted volume successfully. Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ddf0918f-7c85-4be2-ae13-9feba310e2cd tempest-VolumesGetTest-530087925 None] Lock "cinder-fc739202-7233-416f-95e8-42d17440aa35-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-d8378e32-0a43-4a13-a853-065369dbc307-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Lock "cinder-d8378e32-0a43-4a13-a853-065369dbc307-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-quobyte-d8378e32-0a43-4a13-a853-065369dbc307" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-d8378e32-0a43-4a13-a853-065369dbc307" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6689fbbc-bab9-4ca1-8dce-561c2e4320f1]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:02 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307 Sep 25 16:14:02 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Flow 'volume_create_manager' (78d094e7-93de-4f3c-a698-390d1bbdfb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793a9dc9-a5d3-4f6c-bd6e-6a96da614fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793a9dc9-a5d3-4f6c-bd6e-6a96da614fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1719439853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997f09d8-435c-4ea4-96b5-67a12442388d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6da8941b7e40249944101343747de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:02Z,use_quota=True,user_id='95c52421cdaf4550bb7bee5c6a2a359e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6052708b-da84-451f-beb5-fc2cbcf50643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6052708b-da84-451f-beb5-fc2cbcf50643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c8785f-f205-45db-887a-f9db5febfce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c8785f-f205-45db-887a-f9db5febfce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997f09d8-435c-4ea4-96b5-67a12442388d', 'volume_name': 'volume-997f09d8-435c-4ea4-96b5-67a12442388d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6492991-5f8b-4141-87a9-bc45aeb260cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6492991-5f8b-4141-87a9-bc45aeb260cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb774ff-5aa7-46a6-9e71-1043f28e4a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Volume 997f09d8-435c-4ea4-96b5-67a12442388d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997f09d8-435c-4ea4-96b5-67a12442388d', 'volume_size': 1} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1719439853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997f09d8-435c-4ea4-96b5-67a12442388d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6da8941b7e40249944101343747de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:02Z,use_quota=True,user_id='95c52421cdaf4550bb7bee5c6a2a359e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Creating volume 997f09d8-435c-4ea4-96b5-67a12442388d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:02 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:02 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d 1073741824 Sep 25 16:14:02 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:02 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307" returned: 0 in 0.821s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:02 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307 Sep 25 16:14:02 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:03 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d8378e32-0a43-4a13-a853-065369dbc307" returned: 0 in 0.499s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-d8378e32-0a43-4a13-a853-065369dbc307" released by "delete_volume" :: held 1.407s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Created reservations ['b59799fd-295a-4a87-aee0-60613c18c592', '999fb38c-462c-4cf4-9adf-932df0528226', '770921b8-22fc-41c2-8330-2a361e3449ff', '58b5677e-3a23-4b3b-8760-7f45ba9e4782'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:03 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d 1073741824" returned: 0 in 0.864s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:03 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:03 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:03 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d Sep 25 16:14:03 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:03 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.475s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:03 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Deleted volume successfully. Sep 25 16:14:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17398072-02eb-46d3-a4ec-c0298e200ce4 tempest-VolumesGetTest-530087925 None] Lock "cinder-d8378e32-0a43-4a13-a853-065369dbc307-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:04 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d" returned: 0 in 0.666s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb774ff-5aa7-46a6-9e71-1043f28e4a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997f09d8-435c-4ea4-96b5-67a12442388d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bdd17e-64b7-46d8-859b-dcadedadfd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Volume volume-997f09d8-435c-4ea4-96b5-67a12442388d (997f09d8-435c-4ea4-96b5-67a12442388d): created successfully Sep 25 16:14:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bdd17e-64b7-46d8-859b-dcadedadfd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Flow 'volume_create_manager' (78d094e7-93de-4f3c-a698-390d1bbdfb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-97c0f00f-4490-4cdb-94f1-aae4db674947 tempest-VolumesTransfersV357Test-922315547 None] Created volume successfully. Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Acquiring lock "cinder-997f09d8-435c-4ea4-96b5-67a12442388d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Lock "cinder-997f09d8-435c-4ea4-96b5-67a12442388d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (287457d6-9994-4a5d-ad9e-20215005a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1143be5d-fdad-491f-91ae-83779b27bcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Acquiring lock "cinder-quobyte-997f09d8-435c-4ea4-96b5-67a12442388d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1143be5d-fdad-491f-91ae-83779b27bcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1753559822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bae3ec8-e576-4685-a510-eadcf836553c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:05Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19988ad1-e348-4c09-88ac-83f6d6383e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19988ad1-e348-4c09-88ac-83f6d6383e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38b452e-5522-45e4-a9e9-c204f61cc110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38b452e-5522-45e4-a9e9-c204f61cc110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bae3ec8-e576-4685-a510-eadcf836553c', 'volume_name': 'volume-5bae3ec8-e576-4685-a510-eadcf836553c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ff585c-faee-4d4c-9a41-86bced325478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ff585c-faee-4d4c-9a41-86bced325478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b074247a-4aa3-4671-b8eb-f1db7d3ae098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:05 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Volume 5bae3ec8-e576-4685-a510-eadcf836553c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bae3ec8-e576-4685-a510-eadcf836553c', 'volume_size': 1} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1753559822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bae3ec8-e576-4685-a510-eadcf836553c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:05Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Creating volume 5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:05 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Lock "cinder-quobyte-997f09d8-435c-4ea4-96b5-67a12442388d" acquired by "delete_volume" :: waited 0.176s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:05 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c 1073741824 Sep 25 16:14:05 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a1e346-ee90-4b3b-85f9-0b27e512a1f4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:06 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d Sep 25 16:14:06 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:07 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c 1073741824" returned: 0 in 1.160s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:07 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d" returned: 0 in 1.108s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:07 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c Sep 25 16:14:07 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:07 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d Sep 25 16:14:07 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:07 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c" returned: 0 in 0.528s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:07 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b074247a-4aa3-4671-b8eb-f1db7d3ae098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bae3ec8-e576-4685-a510-eadcf836553c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05352de-64df-44a0-bd0a-fdae01b765fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-997f09d8-435c-4ea4-96b5-67a12442388d" returned: 0 in 0.590s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Volume volume-5bae3ec8-e576-4685-a510-eadcf836553c (5bae3ec8-e576-4685-a510-eadcf836553c): created successfully Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05352de-64df-44a0-bd0a-fdae01b765fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (287457d6-9994-4a5d-ad9e-20215005a266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Lock "cinder-quobyte-997f09d8-435c-4ea4-96b5-67a12442388d" released by "delete_volume" :: held 1.906s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-defa1f85-dae6-4d4d-9f95-b4749cbeb220 tempest-VolumesGetTest-530087925 None] Created volume successfully. Sep 25 16:14:07 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Created reservations ['bf46acd5-f95d-435e-945f-175cb61df773', 'd281dd02-db84-4dbb-bcd6-7aa1a3554fa1', 'cc59eaad-353d-41e2-bdb4-6c27b1802404', '1de39f4e-69af-48f0-9d27-e2be4af875e1'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:08 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:08 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:08 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:08 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Deleted volume successfully. Sep 25 16:14:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a41acb0a-ba60-46c4-9be3-dee43651484c tempest-VolumesTransfersV357Test-1994334832 None] Lock "cinder-997f09d8-435c-4ea4-96b5-67a12442388d-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (73f6a1f1-e8eb-4b6d-a20b-4deea179091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b99221-0d03-4c58-b983-c27048b8fae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b99221-0d03-4c58-b983-c27048b8fae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1523873663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f31d821-ce05-4c4f-aa34-dc0e21264626,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5bae3ec8-e576-4685-a510-eadcf836553c,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:10Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb86086-c13e-4e87-bb0a-62cb124ab32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb86086-c13e-4e87-bb0a-62cb124ab32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cb1d71-6327-4194-94cb-4e8da70c7b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cb1d71-6327-4194-94cb-4e8da70c7b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8f31d821-ce05-4c4f-aa34-dc0e21264626', 'volume_name': 'volume-8f31d821-ce05-4c4f-aa34-dc0e21264626', 'volume_size': 1, 'source_volid': '5bae3ec8-e576-4685-a510-eadcf836553c', 'source_volstatus': 'available'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d92fd5f-2bae-4f45-bc91-c5344e3765ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d92fd5f-2bae-4f45-bc91-c5344e3765ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632e0765-237d-4e49-96a1-93569cb86eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Volume 8f31d821-ce05-4c4f-aa34-dc0e21264626: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8f31d821-ce05-4c4f-aa34-dc0e21264626', 'volume_size': 1, 'source_volid': '5bae3ec8-e576-4685-a510-eadcf836553c', 'source_volstatus': 'available'} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:09 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Cloning volume 5bae3ec8-e576-4685-a510-eadcf836553c to volume 8f31d821-ce05-4c4f-aa34-dc0e21264626 Sep 25 16:14:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Creating offline snapshot 72fdc009-3fc8-4c8c-b715-c618e5d03682 of volume 5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:14:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f22a1e-083e-44a4-ba82-3ceb12b81e89]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:10 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c Sep 25 16:14:10 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:10 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c" returned: 0 in 0.680s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:10 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 1G Sep 25 16:14:10 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:11 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 1G" returned: 0 in 0.607s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bae3ec8-e576-4685-a510-eadcf836553c -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:11 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bae3ec8-e576-4685-a510-eadcf836553c -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 Sep 25 16:14:11 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:11 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bae3ec8-e576-4685-a510-eadcf836553c -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682" returned: 0 in 0.482s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:11 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 is being set with open permissions: ugo+rw Sep 25 16:14:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:11 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 Sep 25 16:14:11 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:12 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682" returned: 0 in 0.460s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:12 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=69,cinder:UPDATE=88,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:14:12 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=75,cinder:UPDATE=81,cinder:DELETE=5,cinder:INSERT=25 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:14:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:12 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.info Sep 25 16:14:12 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:13 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.info" returned: 0 in 0.615s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:13 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.info is being set with open permissions: ugo+rw Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:13 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.info Sep 25 16:14:13 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:13 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.info" returned: 0 in 0.497s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-quobyte-8f31d821-ce05-4c4f-aa34-dc0e21264626" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-8f31d821-ce05-4c4f-aa34-dc0e21264626" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] snapshot: 72fdc009-3fc8-4c8c-b715-c618e5d03682, volume: 8f31d821-ce05-4c4f-aa34-dc0e21264626, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c125d434-44b8-4932-b908-9f35f019984e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:13 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 Sep 25 16:14:13 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:14 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682" returned: 0 in 0.630s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bae3ec8-e576-4685-a510-eadcf836553c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:14:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c760e8-14c5-4e2d-b84d-89a9f94bab36]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:14 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c Sep 25 16:14:14 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:14 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c" returned: 0 in 0.583s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:14:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:14:14 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:14:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:14 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 Sep 25 16:14:14 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:22 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=1,cinder:INSERT=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:14:23 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Flow 'volume_create_manager' (7a8b850e-ff67-451e-8631-a065e063983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee2d824-f2e4-4f55-ace5-a49cb191b1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee2d824-f2e4-4f55-ace5-a49cb191b1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1314796793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4485e1-943d-454a-b484-ced1655d03b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e847e2a7464de3a41cf35d46e3ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:24Z,use_quota=True,user_id='53b15a77591048978055d51576a55290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e784054-9b02-4913-818d-ddfa135683b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e784054-9b02-4913-818d-ddfa135683b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ba3f3b-918f-4831-ad2d-8b03783ec9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ba3f3b-918f-4831-ad2d-8b03783ec9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4485e1-943d-454a-b484-ced1655d03b6', 'volume_name': 'volume-4d4485e1-943d-454a-b484-ced1655d03b6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee3b047-3a51-4c20-847f-16fcc0e39154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee3b047-3a51-4c20-847f-16fcc0e39154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171bc4ad-2f88-4d77-b22a-1c9170d371c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:24 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Volume 4d4485e1-943d-454a-b484-ced1655d03b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4485e1-943d-454a-b484-ced1655d03b6', 'volume_size': 1} Sep 25 16:14:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:25 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626" returned: 0 in 10.767s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:25 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c, size 1024.00 MB, duration 10.77 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:14:25 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Converted 1024.00 MB image at 95.10 MB/s Sep 25 16:14:25 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 is being set with open permissions: ugo+rw Sep 25 16:14:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:25 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 Sep 25 16:14:25 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:25 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626" returned: 0 in 0.295s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-8f31d821-ce05-4c4f-aa34-dc0e21264626" released by "_copy_volume_from_snapshot" :: held 12.390s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-quobyte-72fdc009-3fc8-4c8c-b715-c618e5d03682" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-72fdc009-3fc8-4c8c-b715-c618e5d03682" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Deleting offline snapshot 72fdc009-3fc8-4c8c-b715-c618e5d03682 of volume 5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] snapshot_file for this snap is: volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c92752-1e3b-433b-a5f3-7240b087e594]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:26 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 Sep 25 16:14:26 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:26 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682" returned: 0 in 0.411s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bae3ec8-e576-4685-a510-eadcf836553c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79c52b9-b138-4edf-84b4-7da49db59418]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:26 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c Sep 25 16:14:26 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:27 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c" returned: 0 in 0.771s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:27 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 Sep 25 16:14:27 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:27 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682" returned: 0 in 0.461s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:27 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682 Sep 25 16:14:27 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:28 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c.72fdc009-3fc8-4c8c-b715-c618e5d03682" returned: 0 in 0.592s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-72fdc009-3fc8-4c8c-b715-c618e5d03682" released by "_delete_snapshot" :: held 2.397s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.502s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.398s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1314796793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4485e1-943d-454a-b484-ced1655d03b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e847e2a7464de3a41cf35d46e3ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:24Z,use_quota=True,user_id='53b15a77591048978055d51576a55290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Creating volume 4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:28 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:28 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 1073741824 Sep 25 16:14:28 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632e0765-237d-4e49-96a1-93569cb86eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f31d821-ce05-4c4f-aa34-dc0e21264626', 'volume_size': 1, 'source_volid': '5bae3ec8-e576-4685-a510-eadcf836553c', 'source_volstatus': 'available'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac280b0-7629-4a83-858f-b103ee611184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Volume volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 (8f31d821-ce05-4c4f-aa34-dc0e21264626): created successfully Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac280b0-7629-4a83-858f-b103ee611184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (73f6a1f1-e8eb-4b6d-a20b-4deea179091c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-458555d3-34f6-4819-a417-9b68a2eb4079 tempest-VolumesGetTest-530087925 None] Created volume successfully. Sep 25 16:14:29 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 1073741824" returned: 0 in 1.037s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:29 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 Sep 25 16:14:29 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:30 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6" returned: 0 in 0.463s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171bc4ad-2f88-4d77-b22a-1c9170d371c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4485e1-943d-454a-b484-ced1655d03b6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51205413-ed68-4170-bdc0-124a5bacecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Volume volume-4d4485e1-943d-454a-b484-ced1655d03b6 (4d4485e1-943d-454a-b484-ced1655d03b6): created successfully Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51205413-ed68-4170-bdc0-124a5bacecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Flow 'volume_create_manager' (7a8b850e-ff67-451e-8631-a065e063983b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-23423edf-21f6-439a-969f-1bec0421e0ac tempest-VolumesCloneTest-1191002649 None] Created volume successfully. Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (995f44e6-cc4b-4b5d-89e1-eedad7636e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d00a92-cfa3-4ab4-9e56-c0d0e23265e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d00a92-cfa3-4ab4-9e56-c0d0e23265e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2007687674',display_name='tempest-VolumesGetTest-Volume-1774847288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a731f2f5-49a3-4e96-bb8e-6343c40c611d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:30Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c578f876-beec-40fc-a0c9-d9108ceeb29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c578f876-beec-40fc-a0c9-d9108ceeb29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a822e9a7-2b21-43dc-860c-a28e5df52cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a822e9a7-2b21-43dc-860c-a28e5df52cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a731f2f5-49a3-4e96-bb8e-6343c40c611d', 'volume_name': 'volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e3d8a-4a70-4610-bdae-62c7880120ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e3d8a-4a70-4610-bdae-62c7880120ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab68bd4c-fcae-48be-902a-bafeb8487af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Volume a731f2f5-49a3-4e96-bb8e-6343c40c611d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d', 'volume_size': 1} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2007687674',display_name='tempest-VolumesGetTest-Volume-1774847288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a731f2f5-49a3-4e96-bb8e-6343c40c611d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:30Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Creating volume a731f2f5-49a3-4e96-bb8e-6343c40c611d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:30 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:14:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:30 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d 1073741824 Sep 25 16:14:30 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:31 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d 1073741824" returned: 0 in 0.697s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:31 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d Sep 25 16:14:31 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Flow 'volume_create_manager' (31376994-cdf8-499a-bda2-16d73119c0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a3c191-47b7-4d4c-9175-84ef78763ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a3c191-47b7-4d4c-9175-84ef78763ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-148726323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04444a4e-1445-4fc1-a828-854e1f8c08ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e847e2a7464de3a41cf35d46e3ebbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4d4485e1-943d-454a-b484-ced1655d03b6,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:31Z,use_quota=True,user_id='53b15a77591048978055d51576a55290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee0deaa-7e88-4e1f-9926-d51542a5959a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee0deaa-7e88-4e1f-9926-d51542a5959a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8610fbfe-9a40-4375-a7a1-4697ab04c3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8610fbfe-9a40-4375-a7a1-4697ab04c3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '04444a4e-1445-4fc1-a828-854e1f8c08ac', 'volume_name': 'volume-04444a4e-1445-4fc1-a828-854e1f8c08ac', 'volume_size': 2, 'source_volid': '4d4485e1-943d-454a-b484-ced1655d03b6', 'source_volstatus': 'available'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f0d1e0-7c94-42cc-9233-07b05fd4e21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f0d1e0-7c94-42cc-9233-07b05fd4e21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8001b8-4d12-4fd4-979a-27c6e64d96bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Volume 04444a4e-1445-4fc1-a828-854e1f8c08ac: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-04444a4e-1445-4fc1-a828-854e1f8c08ac', 'volume_size': 2, 'source_volid': '4d4485e1-943d-454a-b484-ced1655d03b6', 'source_volstatus': 'available'} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:31 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d" returned: 0 in 0.618s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.284s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:31 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Cloning volume 4d4485e1-943d-454a-b484-ced1655d03b6 to volume 04444a4e-1445-4fc1-a828-854e1f8c08ac Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab68bd4c-fcae-48be-902a-bafeb8487af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31b0b79-69aa-432d-b903-f8ae90893c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Creating offline snapshot cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f of volume 4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:14:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Volume volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d (a731f2f5-49a3-4e96-bb8e-6343c40c611d): created successfully Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31b0b79-69aa-432d-b903-f8ae90893c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (995f44e6-cc4b-4b5d-89e1-eedad7636e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed95677a-33a1-4537-8ed9-15987fa51c1c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-17edd6ed-fd49-446e-b11f-5479d0bf5250 tempest-VolumesGetTest-530087925 None] Created volume successfully. Sep 25 16:14:32 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 Sep 25 16:14:32 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:32 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-a731f2f5-49a3-4e96-bb8e-6343c40c611d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6" returned: 0 in 0.717s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Lock "cinder-a731f2f5-49a3-4e96-bb8e-6343c40c611d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:32 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f 1G Sep 25 16:14:32 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-quobyte-a731f2f5-49a3-4e96-bb8e-6343c40c611d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-a731f2f5-49a3-4e96-bb8e-6343c40c611d" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[531b12ce-1d4d-45ad-9cdc-4eccfbe431ab]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:32 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d Sep 25 16:14:32 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:33 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f 1G" returned: 0 in 0.740s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4485e1-943d-454a-b484-ced1655d03b6 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:33 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4485e1-943d-454a-b484-ced1655d03b6 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f Sep 25 16:14:33 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:33 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d" returned: 0 in 0.775s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:33 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d Sep 25 16:14:33 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:33 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4485e1-943d-454a-b484-ced1655d03b6 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f" returned: 0 in 0.547s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:33 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f is being set with open permissions: ugo+rw Sep 25 16:14:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:33 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f Sep 25 16:14:33 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:34 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a731f2f5-49a3-4e96-bb8e-6343c40c611d" returned: 0 in 0.559s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-a731f2f5-49a3-4e96-bb8e-6343c40c611d" released by "delete_volume" :: held 1.422s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:34 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Created reservations ['af54dc19-f375-49c1-9ccb-5989a87e5f86', '590c1733-cf39-4c1f-a10c-4786af71d58f', 'c6317bc0-a4a9-4d61-8f6e-35a96b894f96', 'fc3427eb-5732-49d2-bad9-6acedf22d4fb'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:34 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.info Sep 25 16:14:34 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:34 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:34 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:35 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.info" returned: 0 in 0.644s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:35 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.info is being set with open permissions: ugo+rw Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:35 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.info Sep 25 16:14:35 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:35 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-8f31d821-ce05-4c4f-aa34-dc0e21264626-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.657s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Deleted volume successfully. Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Lock "cinder-8f31d821-ce05-4c4f-aa34-dc0e21264626-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-889b9ee6-7ffc-42ce-a1a0-342468e35a0e tempest-VolumesGetTest-530087925 None] Lock "cinder-a731f2f5-49a3-4e96-bb8e-6343c40c611d-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-quobyte-8f31d821-ce05-4c4f-aa34-dc0e21264626" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-8f31d821-ce05-4c4f-aa34-dc0e21264626" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:35 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.info" returned: 0 in 0.567s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Acquiring lock "cinder-quobyte-04444a4e-1445-4fc1-a828-854e1f8c08ac" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cad182-d345-4c0f-ae50-f45a1acbbcac]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Lock "cinder-quobyte-04444a4e-1445-4fc1-a828-854e1f8c08ac" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] snapshot: cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f, volume: 04444a4e-1445-4fc1-a828-854e1f8c08ac, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[01931df4-e6e2-410c-b0df-8567a5e15145]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:35 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 Sep 25 16:14:35 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:36 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f Sep 25 16:14:36 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:36 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626" returned: 0 in 0.773s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:36 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f" returned: 0 in 0.658s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4485e1-943d-454a-b484-ced1655d03b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:14:36 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626 Sep 25 16:14:36 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c76279b-4b06-4826-be22-d8a583003e91]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:36 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 Sep 25 16:14:36 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:36 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8f31d821-ce05-4c4f-aa34-dc0e21264626" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-8f31d821-ce05-4c4f-aa34-dc0e21264626" released by "delete_volume" :: held 1.260s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Created reservations ['e5243eaa-8ccf-4c4e-9189-1ce7cfa16624', '69d027ca-7ee4-48c4-a559-93b6c75c9113', '785db092-0388-4098-ad68-00d84281612a', '4cc7ad93-b59e-4986-9527-44aca0f7e4ca'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:37 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:37 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:37 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6" returned: 0 in 0.617s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:37 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac Sep 25 16:14:37 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:37 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Deleted volume successfully. Sep 25 16:14:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3c1956b-8e50-48fd-a2c1-d37e8073f75d tempest-VolumesGetTest-530087925 None] Lock "cinder-8f31d821-ce05-4c4f-aa34-dc0e21264626-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-5bae3ec8-e576-4685-a510-eadcf836553c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Lock "cinder-5bae3ec8-e576-4685-a510-eadcf836553c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-quobyte-5bae3ec8-e576-4685-a510-eadcf836553c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-5bae3ec8-e576-4685-a510-eadcf836553c" acquired by "delete_volume" :: waited 0.044s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[172ff8be-ca21-47af-8bed-b246e72be7ee]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:38 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c Sep 25 16:14:38 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:39 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c" returned: 0 in 0.913s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:39 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c Sep 25 16:14:39 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:39 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5bae3ec8-e576-4685-a510-eadcf836553c" returned: 0 in 0.560s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-5bae3ec8-e576-4685-a510-eadcf836553c" released by "delete_volume" :: held 1.661s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:40 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Created reservations ['c4a00d33-84fb-4530-bc5f-c4b015aa35d4', '3153a37a-c4b9-4582-bc14-6dc69fb9846c', '17eb070a-1721-46e3-94b1-66a3ea6c81c8', '1905b418-4e77-4370-a0d4-30db343c065e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:40 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:40 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:40 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.598s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Deleted volume successfully. Sep 25 16:14:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68edafbb-eb21-4cc0-ab87-344d4696603f tempest-VolumesGetTest-530087925 None] Lock "cinder-5bae3ec8-e576-4685-a510-eadcf836553c-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:43 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (2973c707-c991-47fd-b09a-c7beaa895218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2be43f5-49bb-4e0b-b174-e5f720ca4168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2be43f5-49bb-4e0b-b174-e5f720ca4168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-112298693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad46d2bb-af5e-4946-befa-e175a4e0c02c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:43Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee1340d-71b3-438e-95ec-f120f22a1787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee1340d-71b3-438e-95ec-f120f22a1787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1979c172-ad08-443e-8167-dc4c7a3f7c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:43 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:14:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1979c172-ad08-443e-8167-dc4c7a3f7c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad46d2bb-af5e-4946-befa-e175a4e0c02c', 'volume_name': 'volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3e9128-688d-4107-a13e-cccda4ac048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3e9128-688d-4107-a13e-cccda4ac048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf77a40d-f529-4f12-aada-ea586d3bf2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Volume ad46d2bb-af5e-4946-befa-e175a4e0c02c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:14:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Trying to clone ad46d2bb-af5e-4946-befa-e175a4e0c02c from image 0d17311a-0d04-4242-8696-17a222efd8fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:14:46 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD, size 20.69 MB, duration 1.27 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:14:46 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Image download 20.69 MB at 16.27 MB/s Sep 25 16:14:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9a22c4-af6e-48d3-8b56-47ef13127e59]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:46 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD Sep 25 16:14:46 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:47 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD" returned: 0 in 1.186s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:47 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa is fetched for user a2df9f18b9c84fd3a3d344a78134057c. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:14:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa347afe-fdc4-4cf6-b816-492769f039ed]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:47 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac" returned: 0 in 10.777s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:47 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6, size 1024.00 MB, duration 10.78 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:14:47 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Converted 1024.00 MB image at 95.00 MB/s Sep 25 16:14:47 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac is being set with open permissions: ugo+rw Sep 25 16:14:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:47 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD Sep 25 16:14:47 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:48 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac Sep 25 16:14:48 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:48 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:48 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD" returned: 0 in 0.586s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Lock "cinder-quobyte-04444a4e-1445-4fc1-a828-854e1f8c08ac" released by "_copy_volume_from_snapshot" :: held 12.605s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Acquiring lock "cinder-quobyte-cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Lock "cinder-quobyte-cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Deleting offline snapshot cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f of volume 4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] snapshot_file for this snap is: volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df7b571-334e-4111-9e81-af7ad8f0502c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:48 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f Sep 25 16:14:48 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:49 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f" returned: 0 in 0.767s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4485e1-943d-454a-b484-ced1655d03b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:14:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca68b05-4962-4d66-a5ac-f8c1a3ef0a32]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:49 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 Sep 25 16:14:49 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-42974a71-8f5f-4b52-a5e5-4bfc8bbaf2ba req-343e8865-fbbf-4a97-afa5-088cb59c742b tempest-TestShelveInstance-1299164924 None] Terminate volume connection completed successfully. Sep 25 16:14:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-42974a71-8f5f-4b52-a5e5-4bfc8bbaf2ba req-343e8865-fbbf-4a97-afa5-088cb59c742b tempest-TestShelveInstance-1299164924 None] Deleting attachment ea8bbcb3-b698-4a9e-8fcb-7e6a5be3643e. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:14:50 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6" returned: 0 in 0.853s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:50 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f Sep 25 16:14:50 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:50 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:50 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f Sep 25 16:14:50 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:50 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6.cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Lock "cinder-quobyte-cdf28b35-9a0c-4bd9-aa9e-b4c738fe787f" released by "_delete_snapshot" :: held 2.569s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.327s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.720s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-112298693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad46d2bb-af5e-4946-befa-e175a4e0c02c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:43Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Creating volume ad46d2bb-af5e-4946-befa-e175a4e0c02c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:51 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8001b8-4d12-4fd4-979a-27c6e64d96bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04444a4e-1445-4fc1-a828-854e1f8c08ac', 'volume_size': 2, 'source_volid': '4d4485e1-943d-454a-b484-ced1655d03b6', 'source_volstatus': 'available'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfce4bd-9041-4f0a-9557-04fc5797763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:51 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c 1073741824 Sep 25 16:14:51 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:51 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Volume volume-04444a4e-1445-4fc1-a828-854e1f8c08ac (04444a4e-1445-4fc1-a828-854e1f8c08ac): created successfully Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfce4bd-9041-4f0a-9557-04fc5797763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Flow 'volume_create_manager' (31376994-cdf8-499a-bda2-16d73119c0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f2334ae1-1c6a-4913-8188-136c8a9c518c tempest-VolumesCloneTest-1191002649 None] Created volume successfully. Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Acquiring lock "cinder-04444a4e-1445-4fc1-a828-854e1f8c08ac-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Lock "cinder-04444a4e-1445-4fc1-a828-854e1f8c08ac-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Acquiring lock "cinder-quobyte-04444a4e-1445-4fc1-a828-854e1f8c08ac" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Lock "cinder-quobyte-04444a4e-1445-4fc1-a828-854e1f8c08ac" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:51 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c 1073741824" returned: 0 in 0.867s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3118eb38-dd7b-4fc4-9b36-8af7e9fff542]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:52 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c Sep 25 16:14:52 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:52 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac Sep 25 16:14:52 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:52 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c" returned: 0 in 0.377s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Attempting download of 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume ad46d2bb-af5e-4946-befa-e175a4e0c02c. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ba54e5-b223-4c6b-9ffa-a113b7f58998]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_esao4sqq {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:52 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac" returned: 0 in 0.577s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:52 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac Sep 25 16:14:52 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:52 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_esao4sqq Sep 25 16:14:52 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:53 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04444a4e-1445-4fc1-a828-854e1f8c08ac" returned: 0 in 0.421s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Lock "cinder-quobyte-04444a4e-1445-4fc1-a828-854e1f8c08ac" released by "delete_volume" :: held 1.087s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:53 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_esao4sqq" returned: 0 in 0.540s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_esao4sqq {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Created reservations ['d77d165c-b0ef-4a09-912f-ef0555dedad0', 'f810284e-ecdd-4b12-85cd-388ea7ae741a', '3b2b31d5-843f-4c40-904e-072b639eac6a', 'd35747f0-1b54-4ae7-80b3-d116ab8f1be6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:53 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_esao4sqq Sep 25 16:14:53 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:53 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:53 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6e184542-43d3-4070-82c2-2840072d8433 req-fbb648a1-05df-46c0-a6ea-2e561d5f981b tempest-TestShelveInstance-1299164924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6e184542-43d3-4070-82c2-2840072d8433 req-fbb648a1-05df-46c0-a6ea-2e561d5f981b tempest-TestShelveInstance-1299164924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6e184542-43d3-4070-82c2-2840072d8433 req-fbb648a1-05df-46c0-a6ea-2e561d5f981b tempest-TestShelveInstance-1299164924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-6e184542-43d3-4070-82c2-2840072d8433 req-fbb648a1-05df-46c0-a6ea-2e561d5f981b tempest-TestShelveInstance-1299164924 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7daa9acb-fbae-409b-80cc-5228b8382c58', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:14:53 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-6e184542-43d3-4070-82c2-2840072d8433 req-fbb648a1-05df-46c0-a6ea-2e561d5f981b tempest-TestShelveInstance-1299164924 None] attachment_update completed successfully. Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_esao4sqq" returned: 1 in 0.532s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d17311a-0d04-4242-8696-17a222efd8fa_esao4sqq' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34979c1-1fd0-4a92-ad8c-775a2c3519dc]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:53 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Deleted volume successfully. Sep 25 16:14:53 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD Sep 25 16:14:53 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4873d21-2091-425b-94f4-bc39f7f1fd4e tempest-VolumesCloneTest-1191002649 None] Lock "cinder-04444a4e-1445-4fc1-a828-854e1f8c08ac-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:54 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87314) copy_or_move_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1011}} Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c iflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:54 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c iflag=direct Sep 25 16:14:54 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Acquiring lock "cinder-4d4485e1-943d-454a-b484-ced1655d03b6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Lock "cinder-4d4485e1-943d-454a-b484-ced1655d03b6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Acquiring lock "cinder-quobyte-4d4485e1-943d-454a-b484-ced1655d03b6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Lock "cinder-quobyte-4d4485e1-943d-454a-b484-ced1655d03b6" acquired by "delete_volume" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8398a54-e438-485e-947a-cb8e24c19991]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:54 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:54 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 Sep 25 16:14:54 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c iflag=direct" returned: 0 in 0.564s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:54 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c oflag=direct Sep 25 16:14:54 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:55 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6" returned: 0 in 0.633s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:55 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6 Sep 25 16:14:55 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:55 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c oflag=direct" returned: 0 in 0.513s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:55 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:14:55 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:55 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4485e1-943d-454a-b484-ced1655d03b6" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Lock "cinder-quobyte-4d4485e1-943d-454a-b484-ced1655d03b6" released by "delete_volume" :: held 1.188s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Created reservations ['ac8afc83-9f5f-4697-8880-85d366df4fd3', '8bfc346c-3b47-4b94-8342-fbc453d75b99', '322a4386-7f0c-4c09-946a-cfdae5806f8a', '7361ec39-641c-43e6-ab2b-2e4d192d40ae'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:56 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:56 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:56 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 1.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:56 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_0d17311a-0d04-4242-8696-17a222efd8fa_oa63j2_kdevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c, size 21.00 MB, duration 1.24 sec {{(pid=87314) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:14:56 devstack cinder-volume[87314]: INFO cinder.volume.volume_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Volume copy 21.00 MB at 16.89 MB/s Sep 25 16:14:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:56 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c 1G Sep 25 16:14:56 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:56 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.803s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:56 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Deleted volume successfully. Sep 25 16:14:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee785f5f-3234-4f50-b9a1-ff75b3e73ce7 tempest-VolumesCloneTest-1191002649 None] Lock "cinder-4d4485e1-943d-454a-b484-ced1655d03b6-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:57 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c 1G" returned: 0 in 0.757s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Downloaded image 0d17311a-0d04-4242-8696-17a222efd8fa ((None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}])) to volume ad46d2bb-af5e-4946-befa-e175a4e0c02c successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Temporary image 0d17311a-0d04-4242-8696-17a222efd8fa for user a2df9f18b9c84fd3a3d344a78134057c is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Marking volume ad46d2bb-af5e-4946-befa-e175a4e0c02c as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Copying metadata from image 0d17311a-0d04-4242-8696-17a222efd8fa to ad46d2bb-af5e-4946-befa-e175a4e0c02c. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Creating volume glance metadata for volume ad46d2bb-af5e-4946-befa-e175a4e0c02c backed by image 0d17311a-0d04-4242-8696-17a222efd8fa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf77a40d-f529-4f12-aada-ea586d3bf2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c', 'volume_size': 1, 'image_id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d17311a-0d04-4242-8696-17a222efd8fa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a7f0aa46d90647698dc987e8971db10d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d17311a-0d04-4242-8696-17a222efd8fa', 'created_at': datetime.datetime(2026, 9, 25, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d17311a-0d04-4242-8696-17a222efd8fa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e477c7b0-026e-420a-8cb7-f7e86a027b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:57 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Volume volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c (ad46d2bb-af5e-4946-befa-e175a4e0c02c): created successfully Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e477c7b0-026e-420a-8cb7-f7e86a027b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (2973c707-c991-47fd-b09a-c7beaa895218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1630d545-23c6-42dd-bb78-49d295fa4f3f tempest-VolumesGetTest-530087925 None] Created volume successfully. Sep 25 16:14:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:14:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:58 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:14:58 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.711s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:59 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:14:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:14:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (b408c9eb-ab1c-4add-9f4b-d172aacedaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824f2110-8d51-4a0b-815f-c9b56718e027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824f2110-8d51-4a0b-815f-c9b56718e027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1332098368',display_name='tempest-VolumesGetTest-Volume-686887001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee696e2-8bbb-4146-b447-49c412db0d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:00Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8119b0e-3c2c-4daa-b239-c1b866a05615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8119b0e-3c2c-4daa-b239-c1b866a05615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260ee590-56a2-4ce3-8971-2d3c22f4fa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260ee590-56a2-4ce3-8971-2d3c22f4fa24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee696e2-8bbb-4146-b447-49c412db0d59', 'volume_name': 'volume-8ee696e2-8bbb-4146-b447-49c412db0d59', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead1b6a9-49c0-47d9-bb17-7de4df82769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead1b6a9-49c0-47d9-bb17-7de4df82769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be89a9e7-c8ee-4ed8-82ec-9c06ae487294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Volume 8ee696e2-8bbb-4146-b447-49c412db0d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee696e2-8bbb-4146-b447-49c412db0d59', 'volume_size': 1} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1332098368',display_name='tempest-VolumesGetTest-Volume-686887001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee696e2-8bbb-4146-b447-49c412db0d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d1a1d74754497292afe1a459e78a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:00Z,use_quota=True,user_id='a2df9f18b9c84fd3a3d344a78134057c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Creating volume 8ee696e2-8bbb-4146-b447-49c412db0d59 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:00 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:00 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59 1073741824 Sep 25 16:15:00 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Flow 'volume_create_manager' (e5113f5f-8d78-4685-98bb-7901a4b43cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bda587-4f46-44eb-a70d-a9a177089f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bda587-4f46-44eb-a70d-a9a177089f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-645724218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20b3e58-ed3d-46c7-92d0-c9aa7036823a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457f2f7d7e8a41e4b48ab37941a546ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:00Z,use_quota=True,user_id='54dd97cbba244e47bb505063cf691fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edca91f6-53f9-4e3f-8b9b-766c2c7ec8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edca91f6-53f9-4e3f-8b9b-766c2c7ec8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f53807-3a3e-4977-84ad-acd8e51e8dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f53807-3a3e-4977-84ad-acd8e51e8dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20b3e58-ed3d-46c7-92d0-c9aa7036823a', 'volume_name': 'volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059e1584-b743-4657-a470-42487fe9309d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059e1584-b743-4657-a470-42487fe9309d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3878afa0-052e-4c65-a8fb-141424366eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Volume a20b3e58-ed3d-46c7-92d0-c9aa7036823a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a', 'volume_size': 1} Sep 25 16:15:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:01 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59 1073741824" returned: 0 in 0.776s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:01 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59 Sep 25 16:15:01 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:01 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59" returned: 0 in 0.328s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.929s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-645724218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20b3e58-ed3d-46c7-92d0-c9aa7036823a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457f2f7d7e8a41e4b48ab37941a546ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:00Z,use_quota=True,user_id='54dd97cbba244e47bb505063cf691fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Creating volume a20b3e58-ed3d-46c7-92d0-c9aa7036823a {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:01 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be89a9e7-c8ee-4ed8-82ec-9c06ae487294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee696e2-8bbb-4146-b447-49c412db0d59', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30538469-07c5-4053-bff3-71f532edea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:01 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a 1073741824 Sep 25 16:15:01 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Volume volume-8ee696e2-8bbb-4146-b447-49c412db0d59 (8ee696e2-8bbb-4146-b447-49c412db0d59): created successfully Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30538469-07c5-4053-bff3-71f532edea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Flow 'volume_create_manager' (b408c9eb-ab1c-4add-9f4b-d172aacedaf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-20a3b6ff-868c-40c7-9b4f-8846daccf515 tempest-VolumesGetTest-530087925 None] Created volume successfully. Sep 25 16:15:02 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a 1073741824" returned: 0 in 0.724s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:02 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a Sep 25 16:15:02 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:03 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a" returned: 0 in 0.589s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3878afa0-052e-4c65-a8fb-141424366eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee6e087-59f6-4fa3-a6c9-fbcf32f6dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Volume volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a (a20b3e58-ed3d-46c7-92d0-c9aa7036823a): created successfully Sep 25 16:15:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee6e087-59f6-4fa3-a6c9-fbcf32f6dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Flow 'volume_create_manager' (e5113f5f-8d78-4685-98bb-7901a4b43cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a804a96f-b7d2-410c-befb-baedfa67b410 tempest-AttachVolumeTestJSON-1174005684 None] Created volume successfully. Sep 25 16:15:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-8ee696e2-8bbb-4146-b447-49c412db0d59-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Lock "cinder-8ee696e2-8bbb-4146-b447-49c412db0d59-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-quobyte-8ee696e2-8bbb-4146-b447-49c412db0d59" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-8ee696e2-8bbb-4146-b447-49c412db0d59" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfea9a07-86ca-479f-987f-c4fbd722a70f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:04 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59 Sep 25 16:15:04 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:04 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59" returned: 0 in 0.715s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:04 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59 Sep 25 16:15:04 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:05 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8ee696e2-8bbb-4146-b447-49c412db0d59" returned: 0 in 0.648s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-8ee696e2-8bbb-4146-b447-49c412db0d59" released by "delete_volume" :: held 1.433s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Created reservations ['479780a5-a699-4574-85d7-ab97b3f70737', '13aa0ecf-718c-4775-8df7-5453d298663f', '8a8aba49-35e1-413a-ba46-dcbbfc372815', 'cf5900ae-f2a0-42a4-af23-bfd69bf5ca30'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-f8acd5c1-7554-44b6-9b73-1c0b23c31665 req-645f83a7-c8e5-4117-b8cf-efd903d388fe tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-f8acd5c1-7554-44b6-9b73-1c0b23c31665 req-645f83a7-c8e5-4117-b8cf-efd903d388fe tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-f8acd5c1-7554-44b6-9b73-1c0b23c31665 req-645f83a7-c8e5-4117-b8cf-efd903d388fe tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.067s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:05 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:15:05 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-f8acd5c1-7554-44b6-9b73-1c0b23c31665 req-645f83a7-c8e5-4117-b8cf-efd903d388fe tempest-AttachVolumeTestJSON-1174005684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd296638c-ca49-4d9d-bdb3-713c016323f2', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:15:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-f8acd5c1-7554-44b6-9b73-1c0b23c31665 req-645f83a7-c8e5-4117-b8cf-efd903d388fe tempest-AttachVolumeTestJSON-1174005684 None] attachment_update completed successfully. Sep 25 16:15:06 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.421s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Deleted volume successfully. Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f852f2f0-3c67-41e0-9650-0d9db2659b9c tempest-VolumesGetTest-530087925 None] Lock "cinder-8ee696e2-8bbb-4146-b447-49c412db0d59-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-ad46d2bb-af5e-4946-befa-e175a4e0c02c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Lock "cinder-ad46d2bb-af5e-4946-befa-e175a4e0c02c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Acquiring lock "cinder-quobyte-ad46d2bb-af5e-4946-befa-e175a4e0c02c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-ad46d2bb-af5e-4946-befa-e175a4e0c02c" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[44165f12-89f6-4a68-b99e-1bc594b24765]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:07 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c Sep 25 16:15:07 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:07 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c" returned: 0 in 0.667s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:07 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c Sep 25 16:15:07 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:08 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ad46d2bb-af5e-4946-befa-e175a4e0c02c" returned: 0 in 0.576s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Lock "cinder-quobyte-ad46d2bb-af5e-4946-befa-e175a4e0c02c" released by "delete_volume" :: held 1.330s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:08 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Created reservations ['3dcb7d42-fc98-46d8-a259-794c8c7b96cb', 'd3bc75ee-aa71-4430-9823-6833041df57e', '8ed53e6d-c62c-4d14-822c-b0eb693e9491', 'a76bd869-d7a2-463c-b80a-a37ecb2c33cc'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:08 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:15:08 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:09 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.690s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Deleted volume successfully. Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-41a69058-7047-4ff1-8855-01d6ee9b0ab2 tempest-VolumesGetTest-530087925 None] Lock "cinder-ad46d2bb-af5e-4946-befa-e175a4e0c02c-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Flow 'volume_create_manager' (e747bd52-c692-42f3-8402-462e34a19c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced698d4-88e5-4b6d-b4fa-1315119f6f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced698d4-88e5-4b6d-b4fa-1315119f6f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-553625723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2bc892-c794-4cae-8b1b-747bd1738dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457f2f7d7e8a41e4b48ab37941a546ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:09Z,use_quota=True,user_id='54dd97cbba244e47bb505063cf691fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e82bd3e-e224-485e-a0e7-158336e29d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e82bd3e-e224-485e-a0e7-158336e29d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c35247-6884-4496-8a2c-f5ca066ec8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c35247-6884-4496-8a2c-f5ca066ec8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e2bc892-c794-4cae-8b1b-747bd1738dd7', 'volume_name': 'volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ac1105-b50d-4861-b3d3-75a7a31a3f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ac1105-b50d-4861-b3d3-75a7a31a3f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7a124c-9e5f-43b2-bc4d-3075ff8112c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Volume 9e2bc892-c794-4cae-8b1b-747bd1738dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7', 'volume_size': 1} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-553625723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2bc892-c794-4cae-8b1b-747bd1738dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457f2f7d7e8a41e4b48ab37941a546ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:09Z,use_quota=True,user_id='54dd97cbba244e47bb505063cf691fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Creating volume 9e2bc892-c794-4cae-8b1b-747bd1738dd7 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:09 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:15:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:09 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 1073741824 Sep 25 16:15:09 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:10 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 1073741824" returned: 0 in 0.822s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:10 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 Sep 25 16:15:10 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:10 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7" returned: 0 in 0.583s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7a124c-9e5f-43b2-bc4d-3075ff8112c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa6bff3-fe7f-4763-8913-fb1f8d415174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Volume volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 (9e2bc892-c794-4cae-8b1b-747bd1738dd7): created successfully Sep 25 16:15:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa6bff3-fe7f-4763-8913-fb1f8d415174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Flow 'volume_create_manager' (e747bd52-c692-42f3-8402-462e34a19c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d5eedf5e-d49d-4d6d-80e4-42bdfb7e089e tempest-AttachVolumeTestJSON-1174005684 None] Created volume successfully. Sep 25 16:15:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-ee68c4a8-696d-4776-9f14-95e4324b2d14 req-98117fe6-ab60-4fab-9794-dcb31b4980b4 tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-ee68c4a8-696d-4776-9f14-95e4324b2d14 req-98117fe6-ab60-4fab-9794-dcb31b4980b4 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-ee68c4a8-696d-4776-9f14-95e4324b2d14 req-98117fe6-ab60-4fab-9794-dcb31b4980b4 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-ee68c4a8-696d-4776-9f14-95e4324b2d14 req-98117fe6-ab60-4fab-9794-dcb31b4980b4 tempest-AttachVolumeTestJSON-1174005684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '636992b6-4135-441a-baaa-147f4ead0582', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:15:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-ee68c4a8-696d-4776-9f14-95e4324b2d14 req-98117fe6-ab60-4fab-9794-dcb31b4980b4 tempest-AttachVolumeTestJSON-1174005684 None] attachment_update completed successfully. Sep 25 16:15:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-0dc5f13f-2f3a-4bca-9f1b-4ca920817e20 req-01ce8061-6b98-4f49-b2b9-63bf4e1be55e tempest-AttachVolumeTestJSON-1174005684 None] Terminate volume connection completed successfully. Sep 25 16:15:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-0dc5f13f-2f3a-4bca-9f1b-4ca920817e20 req-01ce8061-6b98-4f49-b2b9-63bf4e1be55e tempest-AttachVolumeTestJSON-1174005684 None] Deleting attachment d296638c-ca49-4d9d-bdb3-713c016323f2. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:15:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-30b08964-5e08-4a8f-a1b9-7de717c39b72 req-c95f18a1-4cd4-4c17-8fd6-e93e1d65fdf9 tempest-AttachVolumeTestJSON-1174005684 None] Terminate volume connection completed successfully. Sep 25 16:15:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-30b08964-5e08-4a8f-a1b9-7de717c39b72 req-c95f18a1-4cd4-4c17-8fd6-e93e1d65fdf9 tempest-AttachVolumeTestJSON-1174005684 None] Deleting attachment 636992b6-4135-441a-baaa-147f4ead0582. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=85,cinder:SELECT=89,cinder:DELETE=8,cinder:INSERT=20 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=79,cinder:UPDATE=93,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (62967dcd-9df6-4aeb-9c6f-55c9b876730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319ae968-acdf-4b79-8296-cd87975d44ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319ae968-acdf-4b79-8296-cd87975d44ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-691680350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e14e07-86e4-4fd7-a1d2-85ea83111e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc2917f1c6c41acba71bfbca7a0ca16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:24Z,use_quota=True,user_id='e4cd57e5949b429ea153d88726a38ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf87af56-5fa5-4874-9134-842be807e5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf87af56-5fa5-4874-9134-842be807e5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c962e9-2325-4d2d-a610-91d8a47de796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c962e9-2325-4d2d-a610-91d8a47de796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e14e07-86e4-4fd7-a1d2-85ea83111e02', 'volume_name': 'volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7734af-1615-4b1d-ba7c-edc9ffc7d2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7734af-1615-4b1d-ba7c-edc9ffc7d2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c9c5e0-c32c-45b5-8a2a-6b776e650e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:24 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Volume 74e14e07-86e4-4fd7-a1d2-85ea83111e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02', 'volume_size': 1} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-691680350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e14e07-86e4-4fd7-a1d2-85ea83111e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc2917f1c6c41acba71bfbca7a0ca16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:24Z,use_quota=True,user_id='e4cd57e5949b429ea153d88726a38ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Creating volume 74e14e07-86e4-4fd7-a1d2-85ea83111e02 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:24 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:15:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:24 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 1073741824 Sep 25 16:15:24 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:25 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 1073741824" returned: 0 in 0.629s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:25 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 Sep 25 16:15:25 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:25 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02" returned: 0 in 0.331s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c9c5e0-c32c-45b5-8a2a-6b776e650e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af8f34e-54ed-406c-8f1a-32e35d008642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:25 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Volume volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 (74e14e07-86e4-4fd7-a1d2-85ea83111e02): created successfully Sep 25 16:15:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af8f34e-54ed-406c-8f1a-32e35d008642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (62967dcd-9df6-4aeb-9c6f-55c9b876730b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-38f898f5-435c-42b0-ad70-93d6b4afb4bf tempest-VolumesSnapshotTestJSON-811906917 None] Created volume successfully. Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "cinder-9e2bc892-c794-4cae-8b1b-747bd1738dd7-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-9e2bc892-c794-4cae-8b1b-747bd1738dd7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "cinder-quobyte-9e2bc892-c794-4cae-8b1b-747bd1738dd7" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-quobyte-9e2bc892-c794-4cae-8b1b-747bd1738dd7" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[271d9412-38c6-4620-bb27-47c462e0f94c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:26 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 Sep 25 16:15:26 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Creating offline snapshot 7e266010-6496-4225-b819-d5fee14c9d01 of volume 74e14e07-86e4-4fd7-a1d2-85ea83111e02 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf3cb8b-5e31-44a2-a496-7a8900d57098]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:26 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7" returned: 0 in 0.598s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:27 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7 Sep 25 16:15:27 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:27 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 Sep 25 16:15:27 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:27 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9e2bc892-c794-4cae-8b1b-747bd1738dd7" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-quobyte-9e2bc892-c794-4cae-8b1b-747bd1738dd7" released by "delete_volume" :: held 0.947s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Created reservations ['68f5700a-ee32-4f20-b867-af7b162a4816', 'c914fdfa-4647-4686-b9d5-8e9b5e59fb7d', '0a54f450-e05d-43c3-916d-7e037819a27d', 'd7346016-2010-4ca4-88e2-280f8f0a2114'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:27 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02" returned: 0 in 0.484s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:27 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 1G Sep 25 16:15:27 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:27 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:15:27 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:27 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Deleted volume successfully. Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1031414a-2151-4418-b605-31f8f98a7461 tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-9e2bc892-c794-4cae-8b1b-747bd1738dd7-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:27 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 1G" returned: 0 in 0.607s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:28 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 Sep 25 16:15:28 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:28 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01" returned: 0 in 0.393s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:28 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 is being set with open permissions: ugo+rw Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:28 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 Sep 25 16:15:28 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "cinder-a20b3e58-ed3d-46c7-92d0-c9aa7036823a-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-a20b3e58-ed3d-46c7-92d0-c9aa7036823a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "cinder-quobyte-a20b3e58-ed3d-46c7-92d0-c9aa7036823a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-quobyte-a20b3e58-ed3d-46c7-92d0-c9aa7036823a" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[240cf7cf-b523-4d71-aac6-683bd804f9b3]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:28 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01" returned: 0 in 0.412s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:28 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.info Sep 25 16:15:28 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:28 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a Sep 25 16:15:28 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:29 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.info" returned: 0 in 0.356s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.info is being set with open permissions: ugo+rw Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:29 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.info Sep 25 16:15:29 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:29 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a" returned: 0 in 0.541s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:29 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a Sep 25 16:15:29 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:29 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.info" returned: 0 in 0.321s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.720s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:29 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a20b3e58-ed3d-46c7-92d0-c9aa7036823a" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-quobyte-a20b3e58-ed3d-46c7-92d0-c9aa7036823a" released by "delete_volume" :: held 0.925s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0d7a75cd-c131-4582-820c-6b0e75ce6f93 tempest-VolumesSnapshotTestJSON-811906917 None] Create snapshot completed successfully Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Created reservations ['b75a9421-f983-4575-861c-fc54cbedfd5c', 'e94ba38f-be46-4e4a-b160-ecb6c0e18ad7', '073115e2-5b27-4fe2-a577-42578018e08d', '8c97f488-8f8f-49b4-a7c9-44fec9c39c0b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:29 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:15:29 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:30 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.504s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Deleted volume successfully. Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-7e266010-6496-4225-b819-d5fee14c9d01-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-7e266010-6496-4225-b819-d5fee14c9d01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a59630f-66f0-4e92-8106-15970e67a716 tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-a20b3e58-ed3d-46c7-92d0-c9aa7036823a-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-74e14e07-86e4-4fd7-a1d2-85ea83111e02" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-74e14e07-86e4-4fd7-a1d2-85ea83111e02" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-7e266010-6496-4225-b819-d5fee14c9d01" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-7e266010-6496-4225-b819-d5fee14c9d01" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Deleting offline snapshot 7e266010-6496-4225-b819-d5fee14c9d01 of volume 74e14e07-86e4-4fd7-a1d2-85ea83111e02 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] snapshot_file for this snap is: volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d6cb9b-3d25-42aa-aa5c-0a8ff329e081]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:30 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 Sep 25 16:15:30 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "cinder-bdac5f6f-025c-476d-abe8-1b6a59fd9682-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-bdac5f6f-025c-476d-abe8-1b6a59fd9682-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "cinder-quobyte-bdac5f6f-025c-476d-abe8-1b6a59fd9682" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-quobyte-bdac5f6f-025c-476d-abe8-1b6a59fd9682" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:31 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01" returned: 0 in 0.666s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e833ddb-58b6-475a-aa44-104e7ba45d65]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df15cc2-8764-471d-91ab-e38618cb9186]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:31 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 Sep 25 16:15:31 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:31 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 Sep 25 16:15:31 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:31 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682" returned: 0 in 0.552s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:31 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:31 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682 Sep 25 16:15:31 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02" returned: 0 in 0.596s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:32 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 Sep 25 16:15:32 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:32 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdac5f6f-025c-476d-abe8-1b6a59fd9682" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-quobyte-bdac5f6f-025c-476d-abe8-1b6a59fd9682" released by "delete_volume" :: held 0.987s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Created reservations ['44b8e9ef-e05a-444a-b4b7-d9992232a4e9', '6b28ba02-40f7-44f7-b85e-81c7a6241fc1', '776172f5-e1e1-4bd1-9387-5bbdcc92fe6d', 'b95b6de1-b4e9-44fc-acd5-95265248ffbe'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:32 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:15:32 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:32 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01" returned: 0 in 0.667s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:32 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01 Sep 25 16:15:32 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:32 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Deleted volume successfully. Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-af9ae48f-77ae-4ba2-bfb8-c8e922d4981d tempest-AttachVolumeTestJSON-1174005684 None] Lock "cinder-bdac5f6f-025c-476d-abe8-1b6a59fd9682-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:32 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02.7e266010-6496-4225-b819-d5fee14c9d01" returned: 0 in 0.338s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-7e266010-6496-4225-b819-d5fee14c9d01" released by "_delete_snapshot" :: held 2.441s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-74e14e07-86e4-4fd7-a1d2-85ea83111e02" released by "delete_snapshot" :: held 2.477s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Created reservations ['a6c5161e-a69a-45fd-8251-759ca04c8816', 'ed6a8958-38ae-4594-b109-7d40c80e1721', '422e43e3-8f00-42df-b72d-87a5723ca4cf', '45463e86-4687-4ee4-bfcf-67d7946e95a0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Delete snapshot completed successfully. Sep 25 16:15:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6d7b745a-ada2-405c-825e-ba412f295a77 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-7e266010-6496-4225-b819-d5fee14c9d01-delete_snapshot" released by "delete_snapshot" :: held 2.721s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (a284fae7-fdc0-4b36-a8fe-d22ecbe0fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04c0ecb-3c42-49d2-8eea-8a94a4a67b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04c0ecb-3c42-49d2-8eea-8a94a4a67b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1509390412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc2917f1c6c41acba71bfbca7a0ca16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:34Z,use_quota=True,user_id='e4cd57e5949b429ea153d88726a38ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9edcd2-e633-4830-b8f6-4a5da511e0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9edcd2-e633-4830-b8f6-4a5da511e0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b7974d-0212-4145-ae03-1778d5e255b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b7974d-0212-4145-ae03-1778d5e255b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6', 'volume_name': 'volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b15310-0934-4fe0-86a7-0baaf876536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b15310-0934-4fe0-86a7-0baaf876536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b17e6c-725b-4400-b36d-0ff6affcb0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Volume 24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6', 'volume_size': 1} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1509390412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc2917f1c6c41acba71bfbca7a0ca16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:34Z,use_quota=True,user_id='e4cd57e5949b429ea153d88726a38ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Creating volume 24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:34 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:15:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:34 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 1073741824 Sep 25 16:15:34 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:35 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 1073741824" returned: 0 in 0.716s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:35 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 Sep 25 16:15:35 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:35 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b17e6c-725b-4400-b36d-0ff6affcb0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7266119-bd1c-4f2e-97b6-d3cc4ddcd11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Volume volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 (24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6): created successfully Sep 25 16:15:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7266119-bd1c-4f2e-97b6-d3cc4ddcd11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (a284fae7-fdc0-4b36-a8fe-d22ecbe0fee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bfbfc8e5-aa35-4021-b38d-dea5e2f8c6fc tempest-VolumesSnapshotTestJSON-811906917 None] Created volume successfully. Sep 25 16:15:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Creating offline snapshot ff512ba2-a103-4055-85af-f36c3b087c67 of volume 24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:15:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50257a7-2888-4d94-82ba-10fadc3e1724]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:37 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 Sep 25 16:15:37 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:37 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" returned: 0 in 0.597s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:37 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 1G Sep 25 16:15:37 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:38 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 1G" returned: 0 in 0.659s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:38 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 Sep 25 16:15:38 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:38 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67" returned: 0 in 0.429s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:38 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 is being set with open permissions: ugo+rw Sep 25 16:15:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:38 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 Sep 25 16:15:38 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:39 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67" returned: 0 in 0.414s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:39 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.info Sep 25 16:15:39 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:39 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.info" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:39 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.info is being set with open permissions: ugo+rw Sep 25 16:15:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:39 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.info Sep 25 16:15:39 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:40 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.info" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.992s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8bd3c135-e459-477a-a4ad-315cbd17e378 tempest-VolumesSnapshotTestJSON-811906917 None] Create snapshot completed successfully Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (b54d7a8b-1db9-45ca-8189-5aa7fe0ecbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d358e0-7ee9-467d-9810-f59520502908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d358e0-7ee9-467d-9810-f59520502908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1482621372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb99dc25-2675-420f-9b49-0abfbab4bc39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc2917f1c6c41acba71bfbca7a0ca16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ff512ba2-a103-4055-85af-f36c3b087c67,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:41Z,use_quota=True,user_id='e4cd57e5949b429ea153d88726a38ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6754e488-6ac1-4150-b775-20ba5f58fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6754e488-6ac1-4150-b775-20ba5f58fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d785b43-6334-41eb-8d88-7b9344a7c4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d785b43-6334-41eb-8d88-7b9344a7c4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb99dc25-2675-420f-9b49-0abfbab4bc39', 'volume_name': 'volume-eb99dc25-2675-420f-9b49-0abfbab4bc39', 'volume_size': 2, 'snapshot_id': 'ff512ba2-a103-4055-85af-f36c3b087c67'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9e0196-6c45-4a23-bda3-0eae833b0ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9e0196-6c45-4a23-bda3-0eae833b0ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2101eb9e-3db8-4ce1-8bf7-4ed31dc87735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Volume eb99dc25-2675-420f-9b49-0abfbab4bc39: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb99dc25-2675-420f-9b49-0abfbab4bc39', 'volume_size': 2, 'snapshot_id': 'ff512ba2-a103-4055-85af-f36c3b087c67'} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-ff512ba2-a103-4055-85af-f36c3b087c67-eb99dc25-2675-420f-9b49-0abfbab4bc39" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-ff512ba2-a103-4055-85af-f36c3b087c67-eb99dc25-2675-420f-9b49-0abfbab4bc39" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Creating volume eb99dc25-2675-420f-9b49-0abfbab4bc39 from snapshot ff512ba2-a103-4055-85af-f36c3b087c67 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-eb99dc25-2675-420f-9b49-0abfbab4bc39" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-eb99dc25-2675-420f-9b49-0abfbab4bc39" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] snapshot: ff512ba2-a103-4055-85af-f36c3b087c67, volume: eb99dc25-2675-420f-9b49-0abfbab4bc39, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae4820f-c863-4eb2-baee-bdad162378bd]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:41 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 Sep 25 16:15:41 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:41 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67" returned: 0 in 0.504s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:15:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31b8519-f6db-46b6-944c-6dadfa0aa608]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:42 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 Sep 25 16:15:42 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:42 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" returned: 0 in 0.564s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:15:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:15:42 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:15:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:42 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 Sep 25 16:15:42 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-0286daf1-9052-42c0-8792-b1a01f1ce3ee tempest-TestShelveInstance-1299164924 None] Terminate volume connection completed successfully. Sep 25 16:15:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-0286daf1-9052-42c0-8792-b1a01f1ce3ee tempest-TestShelveInstance-1299164924 None] Deleting attachment 7daa9acb-fbae-409b-80cc-5228b8382c58. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:15:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Acquiring lock "cinder-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Lock "cinder-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Acquiring lock "cinder-quobyte-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Lock "cinder-quobyte-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e" acquired by "delete_volume" :: waited 0.064s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec1087a-e159-410b-bb8d-9938813a53da]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:48 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e Sep 25 16:15:48 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:49 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e" returned: 0 in 1.449s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:49 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e Sep 25 16:15:49 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:50 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e" returned: 0 in 0.701s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Lock "cinder-quobyte-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e" released by "delete_volume" :: held 2.318s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:50 devstack cinder-volume[87314]: DEBUG cinder.quota [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Created reservations ['f432f717-f471-4666-96bc-3358d716e02c', 'd5ced4c6-4d31-428c-b9d2-863483bf0bb7', '9832010f-ab0a-4390-b7fa-b693b8f40790', 'bf9531cb-a749-4815-a848-cd009495e595'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:50 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:15:50 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:51 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.560s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:51 devstack cinder-volume[87314]: DEBUG cinder.manager [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Deleted volume successfully. Sep 25 16:15:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-e0ed1dad-93d0-45bb-9b02-f30f492abe75 req-81667518-af21-444a-829e-b2699b136e1f tempest-TestShelveInstance-1299164924 None] Lock "cinder-3bdeed20-0dfd-4f1e-b953-5399b42a1f8e-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:52 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39" returned: 0 in 9.832s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6, size 1024.00 MB, duration 9.83 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:15:52 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Converted 1024.00 MB image at 104.14 MB/s Sep 25 16:15:52 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 is being set with open permissions: ugo+rw Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:52 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 Sep 25 16:15:52 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:52 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39" returned: 0 in 0.284s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-eb99dc25-2675-420f-9b49-0abfbab4bc39" released by "_copy_volume_from_snapshot" :: held 11.323s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-ff512ba2-a103-4055-85af-f36c3b087c67-eb99dc25-2675-420f-9b49-0abfbab4bc39" released by "_create_volume_from_snapshot" :: held 11.445s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.466s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2101eb9e-3db8-4ce1-8bf7-4ed31dc87735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb99dc25-2675-420f-9b49-0abfbab4bc39', 'volume_size': 2, 'snapshot_id': 'ff512ba2-a103-4055-85af-f36c3b087c67'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3fd3bd-34e1-4821-9c09-1f3898836164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Volume volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 (eb99dc25-2675-420f-9b49-0abfbab4bc39): created successfully Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3fd3bd-34e1-4821-9c09-1f3898836164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (b54d7a8b-1db9-45ca-8189-5aa7fe0ecbb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bb3074d0-0081-453d-93d7-90880c799b26 tempest-VolumesSnapshotTestJSON-811906917 None] Created volume successfully. Sep 25 16:15:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-eb99dc25-2675-420f-9b49-0abfbab4bc39-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-eb99dc25-2675-420f-9b49-0abfbab4bc39-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-eb99dc25-2675-420f-9b49-0abfbab4bc39" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-eb99dc25-2675-420f-9b49-0abfbab4bc39" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf9cbb0-5b43-4e56-a631-c0fe46da7689]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:54 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 Sep 25 16:15:54 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:54 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39" returned: 0 in 0.549s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:54 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39 Sep 25 16:15:54 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:55 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eb99dc25-2675-420f-9b49-0abfbab4bc39" returned: 0 in 0.458s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-eb99dc25-2675-420f-9b49-0abfbab4bc39" released by "delete_volume" :: held 1.075s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Created reservations ['dee41ae8-6d24-41ee-9530-3b639ec272cb', 'db1c7ecd-adea-4dcf-99fd-427813ba77f8', '661a65d2-baee-4119-b79d-10624df46ba8', '29837218-fb67-44be-8e55-0bf68f2ce0d5'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:55 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:15:55 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:55 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Deleted volume successfully. Sep 25 16:15:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da8c1ef1-e944-4cca-b8a6-488a0df0fecc tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-eb99dc25-2675-420f-9b49-0abfbab4bc39-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-ff512ba2-a103-4055-85af-f36c3b087c67-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-ff512ba2-a103-4055-85af-f36c3b087c67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-ff512ba2-a103-4055-85af-f36c3b087c67" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-ff512ba2-a103-4055-85af-f36c3b087c67" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Deleting offline snapshot ff512ba2-a103-4055-85af-f36c3b087c67 of volume 24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] snapshot_file for this snap is: volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a84cefe-a41e-4ef8-bc4d-32fe7317aff7]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:56 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 Sep 25 16:15:56 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:56 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67" returned: 0 in 0.512s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd925d9-0d9e-4f71-9711-3ac016e38998]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:57 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 Sep 25 16:15:57 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:57 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" returned: 0 in 0.702s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:57 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 Sep 25 16:15:57 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:58 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67" returned: 0 in 0.481s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:58 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67 Sep 25 16:15:58 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:58 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6.ff512ba2-a103-4055-85af-f36c3b087c67" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-ff512ba2-a103-4055-85af-f36c3b087c67" released by "_delete_snapshot" :: held 2.209s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" released by "delete_snapshot" :: held 2.271s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:58 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:15:58 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Created reservations ['71f2eeb7-7336-40a5-b34c-ead924ded333', 'da6d4df4-9c7a-4c57-8978-cc20299ee907', '18207390-3706-48cf-a259-23abef340e3f', '51097314-6d89-4526-b3c9-17d63cda3455'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:15:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Delete snapshot completed successfully. Sep 25 16:15:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42394a83-868f-42b7-878b-395da9be55d9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-ff512ba2-a103-4055-85af-f36c3b087c67-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:15:59 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c3bb50-b5d7-42e5-9f64-d7dd41a76b2c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:00 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 Sep 25 16:16:00 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:00 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" returned: 0 in 0.464s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:00 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6 Sep 25 16:16:00 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:00 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" returned: 0 in 0.363s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6" released by "delete_volume" :: held 0.977s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Created reservations ['ed77fa8a-2059-440e-ad32-eed5979d402c', '27c1e344-35c8-4084-928d-6f15fc94df84', '5a8dcbbb-9f48-432e-bf54-d0642aea3223', '24068d67-7447-49e5-af17-0e14d099b5f9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:01 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:16:01 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:01 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.319s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Deleted volume successfully. Sep 25 16:16:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9452b48b-9a97-411b-bdc5-bbd489a77dcd tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-24c6d78b-8dd6-4fe0-95b2-d9808f3a86b6-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:02 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (d1fcdc7d-10a4-44a1-aa85-7caa9ee4f03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4900759-8228-4c4a-bfad-304732594d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4900759-8228-4c4a-bfad-304732594d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545710766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73d3b7a-863e-48c3-8b79-247bbe2988cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc2917f1c6c41acba71bfbca7a0ca16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:03Z,use_quota=True,user_id='e4cd57e5949b429ea153d88726a38ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe3580e-f2d8-4ab3-a0ea-0ce7b4ad2b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe3580e-f2d8-4ab3-a0ea-0ce7b4ad2b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83df1179-2668-4b48-b322-e63877a98bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83df1179-2668-4b48-b322-e63877a98bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73d3b7a-863e-48c3-8b79-247bbe2988cb', 'volume_name': 'volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168c36ce-25e2-4e87-8b7d-51e277e2e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168c36ce-25e2-4e87-8b7d-51e277e2e253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa3f2ee-ef7e-4703-8261-5b63702d14b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Volume b73d3b7a-863e-48c3-8b79-247bbe2988cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb', 'volume_size': 1} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545710766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73d3b7a-863e-48c3-8b79-247bbe2988cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc2917f1c6c41acba71bfbca7a0ca16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:03Z,use_quota=True,user_id='e4cd57e5949b429ea153d88726a38ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Creating volume b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:03 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:03 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb 1073741824 Sep 25 16:16:03 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:03 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb 1073741824" returned: 0 in 0.835s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:03 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb Sep 25 16:16:03 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:04 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb" returned: 0 in 0.547s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa3f2ee-ef7e-4703-8261-5b63702d14b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571d9000-8c19-42e7-b104-bc529a5f6934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Volume volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb (b73d3b7a-863e-48c3-8b79-247bbe2988cb): created successfully Sep 25 16:16:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571d9000-8c19-42e7-b104-bc529a5f6934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (d1fcdc7d-10a4-44a1-aa85-7caa9ee4f03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8d20bb89-6415-493c-8ebf-adee0ce7bd4b tempest-VolumesSnapshotTestJSON-811906917 None] Created volume successfully. Sep 25 16:16:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Creating offline snapshot 15787def-b042-40df-a914-4478787e21dc of volume b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:16:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf81bc7-389e-4d08-9612-2c020088f12e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:05 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb Sep 25 16:16:05 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:05 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb" returned: 0 in 0.387s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:05 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc 1G Sep 25 16:16:05 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:06 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc 1G" returned: 0 in 0.702s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:06 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc Sep 25 16:16:06 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:06 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc" returned: 0 in 0.452s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:06 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc is being set with open permissions: ugo+rw Sep 25 16:16:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:06 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc Sep 25 16:16:06 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:07 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:07 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.info Sep 25 16:16:07 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:07 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.info" returned: 0 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:07 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.info is being set with open permissions: ugo+rw Sep 25 16:16:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:07 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.info Sep 25 16:16:07 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:07 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.info" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7989d2a1-76f4-41ee-9549-e53351639584 tempest-VolumesSnapshotTestJSON-811906917 None] Create snapshot completed successfully Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (5bcb2e62-a763-49e3-bc49-bbff5a28cc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0ccf83-29f5-4940-8769-a14f4c4cb3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0ccf83-29f5-4940-8769-a14f4c4cb3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-156723701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf7bc56-8bf6-4786-960b-1876695d3719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc2917f1c6c41acba71bfbca7a0ca16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=15787def-b042-40df-a914-4478787e21dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:09Z,use_quota=True,user_id='e4cd57e5949b429ea153d88726a38ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07616e08-8833-4550-9747-566f86d42e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07616e08-8833-4550-9747-566f86d42e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cb94f8-a455-4835-85fe-d32b6b7a7bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cb94f8-a455-4835-85fe-d32b6b7a7bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ccf7bc56-8bf6-4786-960b-1876695d3719', 'volume_name': 'volume-ccf7bc56-8bf6-4786-960b-1876695d3719', 'volume_size': 1, 'snapshot_id': '15787def-b042-40df-a914-4478787e21dc'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae05a213-690e-4843-9f80-6d4b226000cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae05a213-690e-4843-9f80-6d4b226000cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b96481-64a4-4d73-acdd-a88927bbca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Volume ccf7bc56-8bf6-4786-960b-1876695d3719: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ccf7bc56-8bf6-4786-960b-1876695d3719', 'volume_size': 1, 'snapshot_id': '15787def-b042-40df-a914-4478787e21dc'} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-15787def-b042-40df-a914-4478787e21dc-ccf7bc56-8bf6-4786-960b-1876695d3719" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-15787def-b042-40df-a914-4478787e21dc-ccf7bc56-8bf6-4786-960b-1876695d3719" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Creating volume ccf7bc56-8bf6-4786-960b-1876695d3719 from snapshot 15787def-b042-40df-a914-4478787e21dc {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-ccf7bc56-8bf6-4786-960b-1876695d3719" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-ccf7bc56-8bf6-4786-960b-1876695d3719" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] snapshot: 15787def-b042-40df-a914-4478787e21dc, volume: ccf7bc56-8bf6-4786-960b-1876695d3719, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eab533-e534-4165-bc16-d5b06d278125]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:09 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc Sep 25 16:16:09 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:10 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc" returned: 0 in 0.455s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:16:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dba8501-8750-40e1-b9a1-4ccb62a95a19]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:10 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb Sep 25 16:16:10 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:10 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb" returned: 0 in 0.613s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:16:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:16:10 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:16:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:10 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 Sep 25 16:16:10 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:19 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=77,cinder:SELECT=71,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:16:19 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=68,cinder:UPDATE=75,cinder:DELETE=5,cinder:INSERT=19 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:16:20 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719" returned: 0 in 9.539s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:20 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb, size 1024.00 MB, duration 9.54 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:16:20 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Converted 1024.00 MB image at 107.34 MB/s Sep 25 16:16:20 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 is being set with open permissions: ugo+rw Sep 25 16:16:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:20 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 Sep 25 16:16:20 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:20 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719" returned: 0 in 0.558s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-ccf7bc56-8bf6-4786-960b-1876695d3719" released by "_copy_volume_from_snapshot" :: held 11.317s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-15787def-b042-40df-a914-4478787e21dc-ccf7bc56-8bf6-4786-960b-1876695d3719" released by "_create_volume_from_snapshot" :: held 11.462s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.482s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b96481-64a4-4d73-acdd-a88927bbca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf7bc56-8bf6-4786-960b-1876695d3719', 'volume_size': 1, 'snapshot_id': '15787def-b042-40df-a914-4478787e21dc'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35b65e1-bcab-453a-bc08-e34a67bc7494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:21 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Volume volume-ccf7bc56-8bf6-4786-960b-1876695d3719 (ccf7bc56-8bf6-4786-960b-1876695d3719): created successfully Sep 25 16:16:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35b65e1-bcab-453a-bc08-e34a67bc7494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Flow 'volume_create_manager' (5bcb2e62-a763-49e3-bc49-bbff5a28cc7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a480a21c-0401-4bf7-b1be-35a045124ac1 tempest-VolumesSnapshotTestJSON-811906917 None] Created volume successfully. Sep 25 16:16:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-ccf7bc56-8bf6-4786-960b-1876695d3719-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-ccf7bc56-8bf6-4786-960b-1876695d3719-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-ccf7bc56-8bf6-4786-960b-1876695d3719" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-ccf7bc56-8bf6-4786-960b-1876695d3719" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c3133-8354-42de-bc79-1deffa45cffa]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:22 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 Sep 25 16:16:22 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:23 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719" returned: 0 in 0.562s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:23 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719 Sep 25 16:16:23 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:23 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ccf7bc56-8bf6-4786-960b-1876695d3719" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-ccf7bc56-8bf6-4786-960b-1876695d3719" released by "delete_volume" :: held 0.995s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Created reservations ['8c35d52e-da52-40ee-aa60-0a4d33b729fc', '6236690d-5b2b-4582-a02a-284862ae5aa0', '5c38abdf-5efd-403c-bc68-1f3732f9d80e', '965cda11-ce84-499d-9d2c-0ac87ae72833'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:23 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:16:23 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:24 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Deleted volume successfully. Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48559181-5a10-4f3f-a9a4-4c6e5069e608 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-ccf7bc56-8bf6-4786-960b-1876695d3719-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-15787def-b042-40df-a914-4478787e21dc-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-15787def-b042-40df-a914-4478787e21dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-b73d3b7a-863e-48c3-8b79-247bbe2988cb" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-b73d3b7a-863e-48c3-8b79-247bbe2988cb" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-15787def-b042-40df-a914-4478787e21dc" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-15787def-b042-40df-a914-4478787e21dc" acquired by "_delete_snapshot" :: waited 0.085s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Deleting offline snapshot 15787def-b042-40df-a914-4478787e21dc of volume b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:16:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] snapshot_file for this snap is: volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:16:25 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8039be7-c381-42ee-b981-9091fb75459a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:25 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc Sep 25 16:16:25 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:26 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc" returned: 0 in 0.962s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:16:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d74fa20-b565-4515-845f-9bfa76f3e855]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:26 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb Sep 25 16:16:26 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:27 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb" returned: 0 in 1.208s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:27 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc Sep 25 16:16:27 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:28 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc" returned: 0 in 0.698s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:28 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc Sep 25 16:16:28 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:28 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb.15787def-b042-40df-a914-4478787e21dc" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-15787def-b042-40df-a914-4478787e21dc" released by "_delete_snapshot" :: held 3.600s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-b73d3b7a-863e-48c3-8b79-247bbe2988cb" released by "delete_snapshot" :: held 3.707s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:28 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Created reservations ['7f9a5195-0a59-4d19-ab22-a7cd78af0125', 'c9701217-89af-49af-bf5d-74f8b962d324', '387013d2-b252-4169-b4ab-624497f03c8e', '468fc30f-b5c1-42ad-ba7b-02609e8695aa'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Delete snapshot completed successfully. Sep 25 16:16:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2d7f6e88-7df6-4a41-84f2-e818d19a3d09 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-15787def-b042-40df-a914-4478787e21dc-delete_snapshot" released by "delete_snapshot" :: held 3.970s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-b73d3b7a-863e-48c3-8b79-247bbe2988cb-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-b73d3b7a-863e-48c3-8b79-247bbe2988cb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-b73d3b7a-863e-48c3-8b79-247bbe2988cb" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-b73d3b7a-863e-48c3-8b79-247bbe2988cb" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:29 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe63f6-9eee-4fb8-82c7-884b588f7246]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:29 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb Sep 25 16:16:29 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:30 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb" returned: 0 in 1.192s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:30 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb Sep 25 16:16:30 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:31 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73d3b7a-863e-48c3-8b79-247bbe2988cb" returned: 0 in 0.544s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-b73d3b7a-863e-48c3-8b79-247bbe2988cb" released by "delete_volume" :: held 1.912s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:31 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Created reservations ['9796547b-2179-48f2-9f21-f8193ac28513', '9d070bca-8785-4cb8-af24-2b0c9a3e95e8', '6d3ddc61-e823-49dc-98dc-f653bd5dd98b', 'fe2c9b4c-b6ef-402e-9669-ade43e4873ab'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:32 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:16:32 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:32 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.409s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:32 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Deleted volume successfully. Sep 25 16:16:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836824a1-9fa6-4fb2-adc1-c6976ba767a1 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-b73d3b7a-863e-48c3-8b79-247bbe2988cb-delete_volume" released by "delete_volume" :: held 3.538s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-74e14e07-86e4-4fd7-a1d2-85ea83111e02-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-74e14e07-86e4-4fd7-a1d2-85ea83111e02-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "cinder-quobyte-74e14e07-86e4-4fd7-a1d2-85ea83111e02" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-74e14e07-86e4-4fd7-a1d2-85ea83111e02" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b547fb67-9b23-4aa2-ae23-3a221070bbb1]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:34 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 Sep 25 16:16:34 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:34 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02" returned: 0 in 1.068s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:34 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02 Sep 25 16:16:34 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:35 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-74e14e07-86e4-4fd7-a1d2-85ea83111e02" returned: 0 in 0.676s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-quobyte-74e14e07-86e4-4fd7-a1d2-85ea83111e02" released by "delete_volume" :: held 1.908s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:35 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Created reservations ['5fa76c14-0924-4803-942c-42640fca4edf', '58177a9c-df60-467e-8615-8569f89d4991', '7ce8c248-89cb-44ff-ab1a-ebd881976b09', '3d373716-e212-47ae-8694-4565e8f84f2b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:35 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:16:35 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:36 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.635s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:36 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Deleted volume successfully. Sep 25 16:16:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6bdd0d7f-5ae2-4b55-88d2-247313d577a9 tempest-VolumesSnapshotTestJSON-811906917 None] Lock "cinder-74e14e07-86e4-4fd7-a1d2-85ea83111e02-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:45 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=20,cinder:UPDATE=34,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:16:46 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Flow 'volume_create_manager' (743725fc-ee6d-4e71-be67-98a9a025e958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45384561-6cad-4760-833f-cda24806f91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45384561-6cad-4760-833f-cda24806f91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-959232267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb86bdba-c5e3-4517-9f30-37bc446b98f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb5e4eaf03f4826bc69af65d65b6b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:53Z,use_quota=True,user_id='7c19455052d44236bb18d4d776d6b1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7df426b-d2ea-4a28-9d69-9bdf1e03061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7df426b-d2ea-4a28-9d69-9bdf1e03061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250b84bb-0116-442c-be8b-810c150f5e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250b84bb-0116-442c-be8b-810c150f5e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb86bdba-c5e3-4517-9f30-37bc446b98f0', 'volume_name': 'volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd1bd9d-6868-43b2-a702-4c92f5130642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd1bd9d-6868-43b2-a702-4c92f5130642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18ff5f5-8693-478a-98cf-76fdbec63dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Volume bb86bdba-c5e3-4517-9f30-37bc446b98f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0', 'volume_size': 1} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-959232267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb86bdba-c5e3-4517-9f30-37bc446b98f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb5e4eaf03f4826bc69af65d65b6b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:53Z,use_quota=True,user_id='7c19455052d44236bb18d4d776d6b1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Creating volume bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:52 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:16:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:52 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 1073741824 Sep 25 16:16:52 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:53 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 1073741824" returned: 0 in 0.522s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:53 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 Sep 25 16:16:53 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:53 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18ff5f5-8693-478a-98cf-76fdbec63dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0293361-fd88-404d-aecc-6eee2092d2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:53 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Volume volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 (bb86bdba-c5e3-4517-9f30-37bc446b98f0): created successfully Sep 25 16:16:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0293361-fd88-404d-aecc-6eee2092d2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Flow 'volume_create_manager' (743725fc-ee6d-4e71-be67-98a9a025e958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8a9cd40b-12d4-49e7-9fe4-f995fa6b99ba tempest-VolumesSnapshotListTestJSON-657172670 None] Created volume successfully. Sep 25 16:16:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Creating offline snapshot c049046c-3035-4f1c-8800-f1260e0b158c of volume bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:16:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd306fd-b6f2-4d92-94f7-31b01a788582]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:55 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 Sep 25 16:16:55 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:55 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0" returned: 0 in 0.491s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:55 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c 1G Sep 25 16:16:55 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:56 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c 1G" returned: 0 in 0.542s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:56 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c Sep 25 16:16:56 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:57 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c" returned: 0 in 0.673s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:57 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c is being set with open permissions: ugo+rw Sep 25 16:16:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:57 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c Sep 25 16:16:57 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:57 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:57 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.info Sep 25 16:16:57 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:57 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.info" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:57 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.info is being set with open permissions: ugo+rw Sep 25 16:16:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:57 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.info Sep 25 16:16:57 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:58 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.info" returned: 0 in 0.340s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.920s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6f3bce70-4f46-4e49-8728-409fc4219b17 tempest-VolumesSnapshotListTestJSON-657172670 None] Create snapshot completed successfully Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:58 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:16:58 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Creating offline snapshot c9e278b0-c7a7-40df-be5a-17a5d211fd88 of volume bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6846238-7f72-4e27-bbe4-541473f306f1]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:59 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c Sep 25 16:16:59 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:59 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.728s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:16:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:16:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:16:59 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c" returned: 0 in 0.571s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:16:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:59 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 1G Sep 25 16:16:59 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Flow 'volume_create_manager' (a63bbea2-9015-4976-ad2d-0363299477ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f690197-763f-4575-9ddc-77033bba6778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f690197-763f-4575-9ddc-77033bba6778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1147188067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45ea672-684b-4238-ac34-4b0f27099e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc38dd4c071749b1bd97144dcce16abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:00Z,use_quota=True,user_id='8bf6077e61d344ee94989142dff0dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fe1490-54e3-48f3-87b9-2c802328c65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fe1490-54e3-48f3-87b9-2c802328c65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe01917-93bd-4cae-a3c9-dc470b303d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe01917-93bd-4cae-a3c9-dc470b303d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e45ea672-684b-4238-ac34-4b0f27099e48', 'volume_name': 'volume-e45ea672-684b-4238-ac34-4b0f27099e48', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2954b7a-a055-48ee-8ab1-0e423e38afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2954b7a-a055-48ee-8ab1-0e423e38afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6469e2b9-e891-4d6d-af0e-61d8d7ca4166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Volume e45ea672-684b-4238-ac34-4b0f27099e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e45ea672-684b-4238-ac34-4b0f27099e48', 'volume_size': 1} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:00 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 1G" returned: 0 in 0.836s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:00 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 Sep 25 16:17:00 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Flow 'volume_create_manager' (3b672e14-ff3f-4b78-8032-393619d46b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03435e4b-e825-4323-a6e4-0c5de8a75bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03435e4b-e825-4323-a6e4-0c5de8a75bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-551980305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84bc45f-b53f-4c70-a980-54e0573cf116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db46337a74a4f21a6d38d1555c81991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:00Z,use_quota=True,user_id='19e9a0ce48364552abbd572621b0df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c730ae-b70b-46f8-a4a5-27506a22fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c730ae-b70b-46f8-a4a5-27506a22fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6027403-f5d4-494a-8f7d-394d7f94728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6027403-f5d4-494a-8f7d-394d7f94728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84bc45f-b53f-4c70-a980-54e0573cf116', 'volume_name': 'volume-b84bc45f-b53f-4c70-a980-54e0573cf116', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7229b8-4054-40e6-a392-57402d218af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7229b8-4054-40e6-a392-57402d218af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c979f507-e46b-4395-935b-638c33796faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Volume b84bc45f-b53f-4c70-a980-54e0573cf116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84bc45f-b53f-4c70-a980-54e0573cf116', 'volume_size': 1} Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:00 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:00 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 is being set with open permissions: ugo+rw Sep 25 16:17:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:00 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 Sep 25 16:17:00 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:01 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88" returned: 0 in 0.329s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1147188067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45ea672-684b-4238-ac34-4b0f27099e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc38dd4c071749b1bd97144dcce16abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:00Z,use_quota=True,user_id='8bf6077e61d344ee94989142dff0dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Creating volume e45ea672-684b-4238-ac34-4b0f27099e48 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:01 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:01 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48 1073741824 Sep 25 16:17:01 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b34df66f-adca-40f4-9839-510aaa469ccf tempest-VolumesSnapshotListTestJSON-657172670 None] Create snapshot completed successfully Sep 25 16:17:01 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48 1073741824" returned: 0 in 0.627s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:01 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48 Sep 25 16:17:01 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:02 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48" returned: 0 in 0.341s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-551980305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84bc45f-b53f-4c70-a980-54e0573cf116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db46337a74a4f21a6d38d1555c81991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:00Z,use_quota=True,user_id='19e9a0ce48364552abbd572621b0df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Creating volume b84bc45f-b53f-4c70-a980-54e0573cf116 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:02 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:02 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116 1073741824 Sep 25 16:17:02 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6469e2b9-e891-4d6d-af0e-61d8d7ca4166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e45ea672-684b-4238-ac34-4b0f27099e48', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bdc8b2-f37a-4824-9408-a81958efcfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Volume volume-e45ea672-684b-4238-ac34-4b0f27099e48 (e45ea672-684b-4238-ac34-4b0f27099e48): created successfully Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bdc8b2-f37a-4824-9408-a81958efcfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Flow 'volume_create_manager' (a63bbea2-9015-4976-ad2d-0363299477ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-afa35ae7-af53-46bc-a35e-b4eb89920899 tempest-AttachVolumeNegativeTest-162056123 None] Created volume successfully. Sep 25 16:17:02 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116 1073741824" returned: 0 in 0.594s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:02 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116 Sep 25 16:17:02 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:03 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116" returned: 0 in 0.275s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.841s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c979f507-e46b-4395-935b-638c33796faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84bc45f-b53f-4c70-a980-54e0573cf116', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da67a20-f14a-4925-9e62-d311fa759daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Creating offline snapshot d890941d-8e7e-4e82-8a28-844a894874bf of volume bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:17:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Volume volume-b84bc45f-b53f-4c70-a980-54e0573cf116 (b84bc45f-b53f-4c70-a980-54e0573cf116): created successfully Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da67a20-f14a-4925-9e62-d311fa759daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Flow 'volume_create_manager' (3b672e14-ff3f-4b78-8032-393619d46b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ec441-5d7d-4109-a08b-e5ad8efad224]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-724a23fc-b0e1-4e1b-bb34-1271654b0e98 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Created volume successfully. Sep 25 16:17:03 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 Sep 25 16:17:03 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:03 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88" returned: 0 in 0.568s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:03 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf 1G Sep 25 16:17:03 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-3f93f173-dcff-420f-bb82-ae4488f99952 req-a12273e2-e88d-42e0-b87c-92fd7efba8fc tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:04 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf 1G" returned: 0 in 0.785s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:04 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf Sep 25 16:17:04 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-9f0331c7-20f0-4ccf-af9c-ea56f0ef1376 req-a7cb2ef8-1402-4215-97a6-244faa7ca7b3 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:05 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:05 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf is being set with open permissions: ugo+rw Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:05 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf Sep 25 16:17:05 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:05 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf" returned: 0 in 0.384s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-3f93f173-dcff-420f-bb82-ae4488f99952 req-a12273e2-e88d-42e0-b87c-92fd7efba8fc tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.066s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-3f93f173-dcff-420f-bb82-ae4488f99952 req-a12273e2-e88d-42e0-b87c-92fd7efba8fc tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-9f0331c7-20f0-4ccf-af9c-ea56f0ef1376 req-a7cb2ef8-1402-4215-97a6-244faa7ca7b3 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.683s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e0eff688-9d93-4661-b37a-41aa0c8e9c5d tempest-VolumesSnapshotListTestJSON-657172670 None] Create snapshot completed successfully Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-3f93f173-dcff-420f-bb82-ae4488f99952 req-a12273e2-e88d-42e0-b87c-92fd7efba8fc tempest-AttachVolumeNegativeTest-162056123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-e45ea672-684b-4238-ac34-4b0f27099e48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '173ad412-ccc7-4882-9fe6-3ca50c79ec59', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-9f0331c7-20f0-4ccf-af9c-ea56f0ef1376 req-a7cb2ef8-1402-4215-97a6-244faa7ca7b3 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.130s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-9f0331c7-20f0-4ccf-af9c-ea56f0ef1376 req-a7cb2ef8-1402-4215-97a6-244faa7ca7b3 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-b84bc45f-b53f-4c70-a980-54e0573cf116', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22fa5881-fd1c-41ce-88ec-c63cdd3f57fe', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:17:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-3f93f173-dcff-420f-bb82-ae4488f99952 req-a12273e2-e88d-42e0-b87c-92fd7efba8fc tempest-AttachVolumeNegativeTest-162056123 None] attachment_update completed successfully. Sep 25 16:17:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-9f0331c7-20f0-4ccf-af9c-ea56f0ef1376 req-a7cb2ef8-1402-4215-97a6-244faa7ca7b3 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] attachment_update completed successfully. Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Flow 'volume_create_manager' (b725ebe1-1b28-46f9-bacd-d4a6b3a75986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec60cfe-8784-458d-82ff-384631fb391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec60cfe-8784-458d-82ff-384631fb391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-979652228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1236a40a-6538-4972-aa47-1d4157cd6ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21eb5897023d44a6912d88c1249f4c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:07Z,use_quota=True,user_id='12dcee5ee5194df0b20b854ea93940bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2a3084-b080-4217-9c6a-ae0c44ef2819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2a3084-b080-4217-9c6a-ae0c44ef2819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcc8830-31c2-4093-ae2b-5dacd10f6329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcc8830-31c2-4093-ae2b-5dacd10f6329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1236a40a-6538-4972-aa47-1d4157cd6ea1', 'volume_name': 'volume-1236a40a-6538-4972-aa47-1d4157cd6ea1', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae33239-b12d-4b2c-93f4-97470c42d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae33239-b12d-4b2c-93f4-97470c42d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8065ea84-9a9d-499d-b51c-838a12dfc3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Volume 1236a40a-6538-4972-aa47-1d4157cd6ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1236a40a-6538-4972-aa47-1d4157cd6ea1', 'volume_size': 1} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-979652228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1236a40a-6538-4972-aa47-1d4157cd6ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21eb5897023d44a6912d88c1249f4c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:07Z,use_quota=True,user_id='12dcee5ee5194df0b20b854ea93940bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Creating volume 1236a40a-6538-4972-aa47-1d4157cd6ea1 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:07 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:07 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 1073741824 Sep 25 16:17:07 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-d890941d-8e7e-4e82-8a28-844a894874bf-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-d890941d-8e7e-4e82-8a28-844a894874bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-quobyte-d890941d-8e7e-4e82-8a28-844a894874bf" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-d890941d-8e7e-4e82-8a28-844a894874bf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Deleting offline snapshot d890941d-8e7e-4e82-8a28-844a894874bf of volume bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] snapshot_file for this snap is: volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0050b4f-40a3-49bc-8b42-1dca3e685495]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:07 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf Sep 25 16:17:07 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:08 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 1073741824" returned: 0 in 0.588s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:08 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 Sep 25 16:17:08 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:08 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf" returned: 0 in 0.463s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8331f4-a710-4570-a1cb-3c341cc990bf]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:08 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 Sep 25 16:17:08 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:08 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1" returned: 0 in 0.346s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8065ea84-9a9d-499d-b51c-838a12dfc3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1236a40a-6538-4972-aa47-1d4157cd6ea1', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0edeeea-a4c8-4d85-a909-f73581023dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Volume volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 (1236a40a-6538-4972-aa47-1d4157cd6ea1): created successfully Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0edeeea-a4c8-4d85-a909-f73581023dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Flow 'volume_create_manager' (b725ebe1-1b28-46f9-bacd-d4a6b3a75986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-39bf5eb7-387b-4b5e-b9fa-8ab174b8fcea tempest-TestImageHashVerification-188480697 None] Created volume successfully. Sep 25 16:17:08 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88" returned: 0 in 0.554s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:08 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf Sep 25 16:17:08 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:09 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf" returned: 0 in 0.627s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:09 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf Sep 25 16:17:09 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:10 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.d890941d-8e7e-4e82-8a28-844a894874bf" returned: 0 in 0.507s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-d890941d-8e7e-4e82-8a28-844a894874bf" released by "_delete_snapshot" :: held 2.324s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" released by "delete_snapshot" :: held 2.360s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:10 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Created reservations ['0f66c224-47d1-47ed-8ceb-fdb151151322', '83685664-1311-4ebc-a83a-f040be5cea5b', 'e30bc3d4-e8da-4fc2-b2c5-52a09e2585cb', 'caa59a71-c18b-4e98-ac4e-4bdb2d86c2ee'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Delete snapshot completed successfully. Sep 25 16:17:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dd2006a7-aa76-4832-bbb7-43315e701867 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-d890941d-8e7e-4e82-8a28-844a894874bf-delete_snapshot" released by "delete_snapshot" :: held 2.686s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dffb4a-f223-49c9-b049-6b5838181b2c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:10 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 Sep 25 16:17:10 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-578ad708-21c6-46d0-a7dd-566b9842f35b req-a7135836-4df7-4df7-aaf1-f05de9579757 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Terminate volume connection completed successfully. Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-578ad708-21c6-46d0-a7dd-566b9842f35b req-a7135836-4df7-4df7-aaf1-f05de9579757 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Deleting attachment 22fa5881-fd1c-41ce-88ec-c63cdd3f57fe. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-c9e278b0-c7a7-40df-be5a-17a5d211fd88-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-c9e278b0-c7a7-40df-be5a-17a5d211fd88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-quobyte-c9e278b0-c7a7-40df-be5a-17a5d211fd88" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-c9e278b0-c7a7-40df-be5a-17a5d211fd88" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Deleting offline snapshot c9e278b0-c7a7-40df-be5a-17a5d211fd88 of volume bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] snapshot_file for this snap is: volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b55b9b-2e00-4564-a903-69dc5a58d462]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:11 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1" returned: 0 in 0.563s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08fcace-5656-4276-9c3c-3ce114f34e70]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:11 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 Sep 25 16:17:11 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:11 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 Sep 25 16:17:11 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Acquiring lock "cinder-b84bc45f-b53f-4c70-a980-54e0573cf116-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "cinder-b84bc45f-b53f-4c70-a980-54e0573cf116-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Acquiring lock "cinder-quobyte-b84bc45f-b53f-4c70-a980-54e0573cf116" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "cinder-quobyte-b84bc45f-b53f-4c70-a980-54e0573cf116" acquired by "delete_volume" :: waited 0.057s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[457e6b0e-ed7a-45fa-ba61-c8bbd1135989]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:11 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88" returned: 0 in 0.662s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:11 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1" returned: 0 in 0.609s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 /opt/stack/data/cinder/conversion/1236a40a-6538-4972-aa47-1d4157cd6ea1.temp_image.e71f9339-3699-4a09-a865-226fb2d4df02cyw6qyi0.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[90811dae-36e9-4732-92cf-d211725524cd]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:11 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 /opt/stack/data/cinder/conversion/1236a40a-6538-4972-aa47-1d4157cd6ea1.temp_image.e71f9339-3699-4a09-a865-226fb2d4df02cyw6qyi0.img Sep 25 16:17:11 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:12 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116 Sep 25 16:17:12 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:12 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c Sep 25 16:17:12 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:12 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116" returned: 0 in 0.575s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:12 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116 Sep 25 16:17:12 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:12 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c" returned: 0 in 0.754s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:12 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 Sep 25 16:17:12 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:13 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b84bc45f-b53f-4c70-a980-54e0573cf116" returned: 0 in 0.854s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "cinder-quobyte-b84bc45f-b53f-4c70-a980-54e0573cf116" released by "delete_volume" :: held 1.543s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:13 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Created reservations ['8b5194d8-3e5a-4c31-887e-8bd38b867365', '37131dc4-6181-4054-a7af-25ea81db7bf5', 'ae2747e8-f331-47a1-b24e-9b079f1c8609', '5e0482b3-4157-49f3-b597-3cc0a5904a5f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:13 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:17:13 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:14 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88" returned: 0 in 1.349s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:14 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88 Sep 25 16:17:14 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:14 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.600s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:14 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Deleted volume successfully. Sep 25 16:17:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9b7fe828-b197-4c4b-a006-83b3dfd9dd73 tempest-TestServerVolumeAttachScenarioOldVersion-14061210 None] Lock "cinder-b84bc45f-b53f-4c70-a980-54e0573cf116-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:14 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c9e278b0-c7a7-40df-be5a-17a5d211fd88" returned: 0 in 0.758s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-c9e278b0-c7a7-40df-be5a-17a5d211fd88" released by "_delete_snapshot" :: held 3.796s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" released by "delete_snapshot" :: held 3.841s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Created reservations ['83aa16c0-d2e3-419c-9202-eb91f3fdc413', '2d614ea3-b4c0-4946-a2e2-b32429fc073c', 'b78a20d2-cd74-42fb-a235-124f2246a683', '099a3571-64e1-45d2-9c23-7af10071cf5e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Delete snapshot completed successfully. Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc5b9041-e755-493b-a2f2-965da004c532 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-c9e278b0-c7a7-40df-be5a-17a5d211fd88-delete_snapshot" released by "delete_snapshot" :: held 4.329s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-c049046c-3035-4f1c-8800-f1260e0b158c-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-c049046c-3035-4f1c-8800-f1260e0b158c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-quobyte-c049046c-3035-4f1c-8800-f1260e0b158c" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-c049046c-3035-4f1c-8800-f1260e0b158c" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Deleting offline snapshot c049046c-3035-4f1c-8800-f1260e0b158c of volume bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:17:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] snapshot_file for this snap is: volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:17:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2ed632-ce6a-4751-9f5c-09f577a38066]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:16 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c Sep 25 16:17:16 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:17 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c" returned: 0 in 1.146s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b5afa1-b21a-42c4-a8c7-f7a2887dbce5]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:17 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 Sep 25 16:17:17 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:18 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0" returned: 0 in 1.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:18 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c Sep 25 16:17:18 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:19 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c" returned: 0 in 1.031s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:19 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c Sep 25 16:17:19 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:20 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0.c049046c-3035-4f1c-8800-f1260e0b158c" returned: 0 in 0.627s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-c049046c-3035-4f1c-8800-f1260e0b158c" released by "_delete_snapshot" :: held 4.673s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" released by "delete_snapshot" :: held 4.755s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Created reservations ['9148d3c4-c9d6-445b-ba10-13fbbe52e379', 'f2d6845f-5aa1-4039-8e4f-853497e73a3b', '6b14d50f-63d9-42ca-ab3b-cf7b5be59b88', 'f95fd639-d7b8-46e2-b6e9-545289c7caa2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Delete snapshot completed successfully. Sep 25 16:17:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da2e6c2c-646b-4c4f-a0a0-f3cbb254c40f tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-c049046c-3035-4f1c-8800-f1260e0b158c-delete_snapshot" released by "delete_snapshot" :: held 5.419s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-bb86bdba-c5e3-4517-9f30-37bc446b98f0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-bb86bdba-c5e3-4517-9f30-37bc446b98f0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" acquired by "delete_volume" :: waited 0.051s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[233eb7e6-d83b-4409-85f6-a42833aafb96]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:22 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 Sep 25 16:17:22 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:22 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0" returned: 0 in 0.680s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:22 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0 Sep 25 16:17:22 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:22 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 /opt/stack/data/cinder/conversion/1236a40a-6538-4972-aa47-1d4157cd6ea1.temp_image.e71f9339-3699-4a09-a865-226fb2d4df02cyw6qyi0.img" returned: 0 in 10.779s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f769c4-12da-4959-9fb9-424f73262dd7]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:22 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 Sep 25 16:17:22 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:23 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bb86bdba-c5e3-4517-9f30-37bc446b98f0" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-quobyte-bb86bdba-c5e3-4517-9f30-37bc446b98f0" released by "delete_volume" :: held 1.294s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Created reservations ['c652c069-df8e-4653-adfb-2e765ccfbe8e', 'c1b7e350-10ee-49f0-94a6-2d210a22af95', '850bb24c-878d-4a55-82be-785232f68d61', 'd47014c0-4397-4b64-97f0-081506e10d49'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:23 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:17:23 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:23 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1" returned: 0 in 0.787s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1, size 1024.00 MB, duration 10.78 sec, destination /opt/stack/data/cinder/conversion/1236a40a-6538-4972-aa47-1d4157cd6ea1.temp_image.e71f9339-3699-4a09-a865-226fb2d4df02cyw6qyi0.img {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:17:23 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Converted 1024.00 MB image at 94.98 MB/s Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] e71f9339-3699-4a09-a865-226fb2d4df02 was raw, no need to convert to raw {{(pid=87314) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1189}} Sep 25 16:17:23 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.441s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Deleted volume successfully. Sep 25 16:17:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7cee5d58-91a9-42d1-ba80-5e569ef46669 tempest-VolumesSnapshotListTestJSON-657172670 None] Lock "cinder-bb86bdba-c5e3-4517-9f30-37bc446b98f0-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:33 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=55,cinder:UPDATE=51,cinder:DELETE=6,cinder:INSERT=14 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:17:33 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=59,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Flow 'volume_create_manager' (bf95aa02-756d-4a9a-83dd-b4a14a8a9c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ce85b6-177a-4f79-9fee-41c0017489b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ce85b6-177a-4f79-9fee-41c0017489b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-792094255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87382ccd-992a-4360-8c7d-046c5b1a650f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853185843e3e4b67a778cb68ba06d61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:34Z,use_quota=True,user_id='b3b158c174bc40c2bfffda9dff305238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b2f689-b746-4d00-a128-bfdfaa5c167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b2f689-b746-4d00-a128-bfdfaa5c167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671e205a-d7aa-4c85-8024-db0e1bb08f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671e205a-d7aa-4c85-8024-db0e1bb08f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87382ccd-992a-4360-8c7d-046c5b1a650f', 'volume_name': 'volume-87382ccd-992a-4360-8c7d-046c5b1a650f', 'volume_size': 2}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd658486-d4e3-4dd1-9e4d-af6680c42eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd658486-d4e3-4dd1-9e4d-af6680c42eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4b4763-529d-41a4-a1bf-6c7cc5adabbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Volume 87382ccd-992a-4360-8c7d-046c5b1a650f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87382ccd-992a-4360-8c7d-046c5b1a650f', 'volume_size': 2} Sep 25 16:17:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:44 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:17:44 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 45.538s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Uploaded volume to glance image-id: e71f9339-3699-4a09-a865-226fb2d4df02. {{(pid=87314) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.743s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-792094255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87382ccd-992a-4360-8c7d-046c5b1a650f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853185843e3e4b67a778cb68ba06d61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:34Z,use_quota=True,user_id='b3b158c174bc40c2bfffda9dff305238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Creating volume 87382ccd-992a-4360-8c7d-046c5b1a650f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:56 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:17:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f 2147483648 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:56 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f 2147483648 Sep 25 16:17:56 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ed75885a-4784-4575-9c36-313960f74f8b tempest-TestImageHashVerification-188480697 None] Copy volume to image completed successfully. Sep 25 16:17:57 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f 2147483648" returned: 0 in 0.887s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:57 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f Sep 25 16:17:57 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Acquiring lock "cinder-1236a40a-6538-4972-aa47-1d4157cd6ea1-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Lock "cinder-1236a40a-6538-4972-aa47-1d4157cd6ea1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Acquiring lock "cinder-quobyte-1236a40a-6538-4972-aa47-1d4157cd6ea1" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Lock "cinder-quobyte-1236a40a-6538-4972-aa47-1d4157cd6ea1" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:57 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f" returned: 0 in 0.507s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60388db-a6ca-44fe-963c-fec79d78dbbd]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4b4763-529d-41a4-a1bf-6c7cc5adabbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87382ccd-992a-4360-8c7d-046c5b1a650f', 'volume_size': 2}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5995c7ba-8719-423d-8e23-a809a0eedb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:57 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Volume volume-87382ccd-992a-4360-8c7d-046c5b1a650f (87382ccd-992a-4360-8c7d-046c5b1a650f): created successfully Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5995c7ba-8719-423d-8e23-a809a0eedb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Flow 'volume_create_manager' (bf95aa02-756d-4a9a-83dd-b4a14a8a9c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-89a403a1-366a-47dc-9a47-443157ba1d3f tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Created volume successfully. Sep 25 16:17:57 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 Sep 25 16:17:57 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:58 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1" returned: 0 in 0.536s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:58 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1 Sep 25 16:17:58 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:58 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:17:58 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:58 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1236a40a-6538-4972-aa47-1d4157cd6ea1" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Lock "cinder-quobyte-1236a40a-6538-4972-aa47-1d4157cd6ea1" released by "delete_volume" :: held 1.036s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:58 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Created reservations ['695794de-3154-463d-8721-2032bbff20d6', '4998cea0-e979-4a9f-a17f-20933d696640', '2b49ead0-f835-4a4d-aec2-0b59dc9cc636', 'a7206492-349a-4e4c-9c46-a69c7f515ab9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:59 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.579s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:59 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:17:59 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Creating offline snapshot c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 of volume 87382ccd-992a-4360-8c7d-046c5b1a650f {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:18:00 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[12374588-bce6-4b8f-8d9a-2e147874a1a0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:00 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.647s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:00 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Deleted volume successfully. Sep 25 16:18:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c831a114-b872-4a27-9bcf-9f266a169e44 tempest-TestImageHashVerification-188480697 None] Lock "cinder-1236a40a-6538-4972-aa47-1d4157cd6ea1-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:00 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f Sep 25 16:18:00 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:00 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f" returned: 0 in 0.685s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 2G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:00 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 2G Sep 25 16:18:00 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:01 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 2G" returned: 0 in 0.915s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87382ccd-992a-4360-8c7d-046c5b1a650f -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:01 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87382ccd-992a-4360-8c7d-046c5b1a650f -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 Sep 25 16:18:01 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:02 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87382ccd-992a-4360-8c7d-046c5b1a650f -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281" returned: 0 in 0.558s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:02 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 is being set with open permissions: ugo+rw Sep 25 16:18:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:02 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 Sep 25 16:18:02 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-5f8063cd-1a7d-4719-954f-e9311e9ca4a5 req-da200325-824d-4a27-bf78-dc6bd02f9c4b tempest-AttachVolumeNegativeTest-162056123 None] Terminate volume connection completed successfully. Sep 25 16:18:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-5f8063cd-1a7d-4719-954f-e9311e9ca4a5 req-da200325-824d-4a27-bf78-dc6bd02f9c4b tempest-AttachVolumeNegativeTest-162056123 None] Deleting attachment 173ad412-ccc7-4882-9fe6-3ca50c79ec59. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:18:02 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281" returned: 0 in 0.437s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:02 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.info Sep 25 16:18:02 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:03 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.info" returned: 0 in 0.579s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:03 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.info is being set with open permissions: ugo+rw Sep 25 16:18:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:03 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.info Sep 25 16:18:03 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:03 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.info" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.817s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d514ebb0-d3f2-4d68-b787-23899f36c892 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Create snapshot completed successfully Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Acquiring lock "cinder-c1a61c57-20fc-4e68-b80c-2f1b9f6d1281-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-c1a61c57-20fc-4e68-b80c-2f1b9f6d1281-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Acquiring lock "cinder-quobyte-87382ccd-992a-4360-8c7d-046c5b1a650f" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-quobyte-87382ccd-992a-4360-8c7d-046c5b1a650f" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Acquiring lock "cinder-quobyte-c1a61c57-20fc-4e68-b80c-2f1b9f6d1281" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-quobyte-c1a61c57-20fc-4e68-b80c-2f1b9f6d1281" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Deleting offline snapshot c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 of volume 87382ccd-992a-4360-8c7d-046c5b1a650f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] snapshot_file for this snap is: volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[54716ba7-b293-4b6d-9d29-84aefa8cafda]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:04 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 Sep 25 16:18:04 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:05 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281" returned: 0 in 0.600s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87382ccd-992a-4360-8c7d-046c5b1a650f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d08a5-c4a1-49ae-bd43-57ae6b2f5879]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:05 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f Sep 25 16:18:05 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:05 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f" returned: 0 in 0.560s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:05 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 Sep 25 16:18:05 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:06 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281" returned: 0 in 0.475s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:06 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281 Sep 25 16:18:06 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:06 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f.c1a61c57-20fc-4e68-b80c-2f1b9f6d1281" returned: 0 in 0.387s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-quobyte-c1a61c57-20fc-4e68-b80c-2f1b9f6d1281" released by "_delete_snapshot" :: held 2.224s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-quobyte-87382ccd-992a-4360-8c7d-046c5b1a650f" released by "delete_snapshot" :: held 2.261s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:06 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Created reservations ['bbba935d-d75a-46dc-a15d-f9ba62021cc3', 'a407ff6c-d109-4c0c-a874-ff9930f2fa35', 'd385deeb-3096-4795-abab-d34446f8a260', '58696ec9-fa85-4b10-9bba-d82c447e8738'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Delete snapshot completed successfully. Sep 25 16:18:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d69219db-ed2e-4ae4-bb95-1a2e89345c16 tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-c1a61c57-20fc-4e68-b80c-2f1b9f6d1281-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Acquiring lock "cinder-87382ccd-992a-4360-8c7d-046c5b1a650f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-87382ccd-992a-4360-8c7d-046c5b1a650f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Acquiring lock "cinder-quobyte-87382ccd-992a-4360-8c7d-046c5b1a650f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-quobyte-87382ccd-992a-4360-8c7d-046c5b1a650f" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7170b893-7d90-43e5-a016-8800f6159cd0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:08 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f Sep 25 16:18:08 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:08 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f" returned: 0 in 0.624s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:08 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f Sep 25 16:18:08 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:09 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-87382ccd-992a-4360-8c7d-046c5b1a650f" returned: 0 in 0.426s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-quobyte-87382ccd-992a-4360-8c7d-046c5b1a650f" released by "delete_volume" :: held 1.189s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Created reservations ['dd865c5f-765d-44cc-9bdd-c9151eb26b7c', 'ecae0a49-944c-4660-bcfd-f0e631747e22', '924a4f9d-9d29-49dd-bcee-2e055172bc95', '38d031da-47f8-4942-8bc3-59f3b8f34824'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:09 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:18:09 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:09 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Deleted volume successfully. Sep 25 16:18:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d6f9f038-4f43-4661-8fd2-3db071266d7a tempest-VolumesSnapshotNegativeTestJSON-211090319 None] Lock "cinder-87382ccd-992a-4360-8c7d-046c5b1a650f-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:18 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Flow 'volume_create_manager' (2bb642e3-0bc2-40b3-849f-78daa850ed15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e39a931-02e8-4280-92e1-0f7fdc21885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e39a931-02e8-4280-92e1-0f7fdc21885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2100262200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac5ccc1-8419-475d-81db-396bcb501fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530e8c8398e4448bb5c3edb5079fecf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:19Z,use_quota=True,user_id='94dbe126973b415db763ac67ae5957f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a825e2cb-61cf-4c4a-82aa-f47a5b089153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a825e2cb-61cf-4c4a-82aa-f47a5b089153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2ae78a-ed7f-4407-ac00-d1ea8d342784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2ae78a-ed7f-4407-ac00-d1ea8d342784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac5ccc1-8419-475d-81db-396bcb501fa0', 'volume_name': 'volume-3ac5ccc1-8419-475d-81db-396bcb501fa0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6752014d-b6ff-4134-9fdd-fcd82df2d0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6752014d-b6ff-4134-9fdd-fcd82df2d0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0900b6-6709-441d-be91-07f516786b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Volume 3ac5ccc1-8419-475d-81db-396bcb501fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac5ccc1-8419-475d-81db-396bcb501fa0', 'volume_size': 1} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2100262200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac5ccc1-8419-475d-81db-396bcb501fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530e8c8398e4448bb5c3edb5079fecf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:19Z,use_quota=True,user_id='94dbe126973b415db763ac67ae5957f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Creating volume 3ac5ccc1-8419-475d-81db-396bcb501fa0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:19 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:19 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 1073741824 Sep 25 16:18:19 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Flow 'volume_create_manager' (790610cf-3500-468f-b983-186209147f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f63a0c-d36e-4bb2-9a74-f3af2326b66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f63a0c-d36e-4bb2-9a74-f3af2326b66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1231571705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6feafd15-9823-4781-93d8-e5d7de3b84da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530e8c8398e4448bb5c3edb5079fecf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:19Z,use_quota=True,user_id='94dbe126973b415db763ac67ae5957f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc61ec6c-f18f-4169-8b84-4018d4b143dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc61ec6c-f18f-4169-8b84-4018d4b143dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3704f8-018a-400e-9e4a-edc64da03f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3704f8-018a-400e-9e4a-edc64da03f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6feafd15-9823-4781-93d8-e5d7de3b84da', 'volume_name': 'volume-6feafd15-9823-4781-93d8-e5d7de3b84da', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba44706-acb1-4657-abec-16f97f910b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba44706-acb1-4657-abec-16f97f910b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe108914-11ad-4aa1-bce4-9851569d974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Volume 6feafd15-9823-4781-93d8-e5d7de3b84da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6feafd15-9823-4781-93d8-e5d7de3b84da', 'volume_size': 1} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:19 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 1073741824" returned: 0 in 0.773s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:19 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 Sep 25 16:18:19 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:20 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0" returned: 0 in 0.375s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.648s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1231571705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6feafd15-9823-4781-93d8-e5d7de3b84da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530e8c8398e4448bb5c3edb5079fecf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:19Z,use_quota=True,user_id='94dbe126973b415db763ac67ae5957f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Creating volume 6feafd15-9823-4781-93d8-e5d7de3b84da {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:20 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0900b6-6709-441d-be91-07f516786b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac5ccc1-8419-475d-81db-396bcb501fa0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4580f30e-6af1-48bf-927f-955a109da5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:20 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da 1073741824 Sep 25 16:18:20 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Volume volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 (3ac5ccc1-8419-475d-81db-396bcb501fa0): created successfully Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4580f30e-6af1-48bf-927f-955a109da5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Flow 'volume_create_manager' (2bb642e3-0bc2-40b3-849f-78daa850ed15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f994f3c6-49bb-4a7c-9185-f0d36d1de974 tempest-TestServerVolumeAttachmentScenario-204688708 None] Created volume successfully. Sep 25 16:18:21 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da 1073741824" returned: 0 in 0.744s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:21 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da Sep 25 16:18:21 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:21 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe108914-11ad-4aa1-bce4-9851569d974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6feafd15-9823-4781-93d8-e5d7de3b84da', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddf8914-d372-403c-b5f9-c64f09572e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:21 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Volume volume-6feafd15-9823-4781-93d8-e5d7de3b84da (6feafd15-9823-4781-93d8-e5d7de3b84da): created successfully Sep 25 16:18:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddf8914-d372-403c-b5f9-c64f09572e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Flow 'volume_create_manager' (790610cf-3500-468f-b983-186209147f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-48e97d65-345e-49fc-bb86-289b0f6472ad tempest-TestServerVolumeAttachmentScenario-204688708 None] Created volume successfully. Sep 25 16:18:31 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=25,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:18:31 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=31,cinder:SELECT=26,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:18:33 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (8a17b78c-84c9-40dd-9b89-0b945f2cc53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d84206-5522-41ac-9c82-99f90eaa1ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d84206-5522-41ac-9c82-99f90eaa1ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-994781329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c32a2d7-fc2d-432c-a589-35a418061c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:34Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8280d30c-4a2c-471d-be69-51e4077be0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8280d30c-4a2c-471d-be69-51e4077be0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a0b764-25b6-4f83-a3f9-a62565981990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a0b764-25b6-4f83-a3f9-a62565981990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c32a2d7-fc2d-432c-a589-35a418061c6f', 'volume_name': 'volume-2c32a2d7-fc2d-432c-a589-35a418061c6f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1449fff3-3738-4f0a-aa37-de4d1bfdf3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1449fff3-3738-4f0a-aa37-de4d1bfdf3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140468ee-660f-4c0d-b530-27d33680d69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume 2c32a2d7-fc2d-432c-a589-35a418061c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c32a2d7-fc2d-432c-a589-35a418061c6f', 'volume_size': 1} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-994781329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c32a2d7-fc2d-432c-a589-35a418061c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:34Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Creating volume 2c32a2d7-fc2d-432c-a589-35a418061c6f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:34 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:34 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f 1073741824 Sep 25 16:18:34 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:34 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f 1073741824" returned: 0 in 0.786s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:35 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f Sep 25 16:18:35 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:35 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f" returned: 0 in 0.530s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140468ee-660f-4c0d-b530-27d33680d69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c32a2d7-fc2d-432c-a589-35a418061c6f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8f447a-6f82-43f6-a897-66f70bb18a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume volume-2c32a2d7-fc2d-432c-a589-35a418061c6f (2c32a2d7-fc2d-432c-a589-35a418061c6f): created successfully Sep 25 16:18:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8f447a-6f82-43f6-a897-66f70bb18a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (8a17b78c-84c9-40dd-9b89-0b945f2cc53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-74f0c158-7290-42db-a023-7f13c8372bcf tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created volume successfully. Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (7cf8a2db-3a96-4a35-b60a-76c28bebe36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb7fcd9-fe5b-404b-ade2-82504e4e8406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb7fcd9-fe5b-404b-ade2-82504e4e8406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-483656555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995e58bc-06c8-40d7-8b62-b07d7a8f17aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:37Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9652a56-af47-4031-88c2-dba7fc9de44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9652a56-af47-4031-88c2-dba7fc9de44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568054b9-e75d-46d0-9f2e-5c95d59c166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568054b9-e75d-46d0-9f2e-5c95d59c166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '995e58bc-06c8-40d7-8b62-b07d7a8f17aa', 'volume_name': 'volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84947bd-7302-4dc2-bcf5-ec8761f8063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84947bd-7302-4dc2-bcf5-ec8761f8063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7065ac75-e97b-4cf2-b7ba-01894092157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume 995e58bc-06c8-40d7-8b62-b07d7a8f17aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa', 'volume_size': 1} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-483656555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995e58bc-06c8-40d7-8b62-b07d7a8f17aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:37Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Creating volume 995e58bc-06c8-40d7-8b62-b07d7a8f17aa {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:37 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:18:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:37 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa 1073741824 Sep 25 16:18:37 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:38 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (1b7c5659-550e-469f-8277-f7ce0ebafa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3bc9d3-93e3-4c20-9a8c-ff042138c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa 1073741824" returned: 0 in 1.077s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3bc9d3-93e3-4c20-9a8c-ff042138c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-543539564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423e84ff-1def-450f-a966-427debdb1e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:38Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105cc27b-be15-48f3-8179-d5c2ef8e72fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105cc27b-be15-48f3-8179-d5c2ef8e72fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a824707-7263-44e0-aec4-1f4e7be882d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a824707-7263-44e0-aec4-1f4e7be882d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423e84ff-1def-450f-a966-427debdb1e10', 'volume_name': 'volume-423e84ff-1def-450f-a966-427debdb1e10', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f700ec4a-d9b8-4133-b64b-cf4e448ccf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f700ec4a-d9b8-4133-b64b-cf4e448ccf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ed162f-911e-48a3-b542-4bbd09f19558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:38 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume 423e84ff-1def-450f-a966-427debdb1e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423e84ff-1def-450f-a966-427debdb1e10', 'volume_size': 1} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:38 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa Sep 25 16:18:38 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:38 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa" returned: 0 in 0.515s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.551s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-543539564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423e84ff-1def-450f-a966-427debdb1e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:38Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Creating volume 423e84ff-1def-450f-a966-427debdb1e10 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:38 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7065ac75-e97b-4cf2-b7ba-01894092157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:38 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10 1073741824 Sep 25 16:18:38 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8342ba-60f9-4bd4-8b5e-28d576f22021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:38 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa (995e58bc-06c8-40d7-8b62-b07d7a8f17aa): created successfully Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8342ba-60f9-4bd4-8b5e-28d576f22021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (7cf8a2db-3a96-4a35-b60a-76c28bebe36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e54a3b31-809d-4d73-857c-c269a28055b5 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created volume successfully. Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (8344d510-ec2c-4ef6-985d-bc95fa745eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ada438-7dd9-4d2b-af63-9a109828aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ada438-7dd9-4d2b-af63-9a109828aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1077652535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1677c11-332e-44cd-9707-27d529ffd843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:39Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e03c3-4ba8-47cd-a092-fa6e0f92793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e03c3-4ba8-47cd-a092-fa6e0f92793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793a189e-acff-470d-a6ad-88468afb1b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793a189e-acff-470d-a6ad-88468afb1b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1677c11-332e-44cd-9707-27d529ffd843', 'volume_name': 'volume-b1677c11-332e-44cd-9707-27d529ffd843', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9162bd-45be-4199-84d1-971f093149ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9162bd-45be-4199-84d1-971f093149ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8931930-7090-4336-80c5-9c254eb106da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume b1677c11-332e-44cd-9707-27d529ffd843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1677c11-332e-44cd-9707-27d529ffd843', 'volume_size': 1} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (51740851-0519-4a84-853d-e863441c279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faae0b0-ae3c-4442-beb4-c58210b73fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faae0b0-ae3c-4442-beb4-c58210b73fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1437842690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9160429f-3a6a-4bb7-b30e-06e262e717b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:40Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ec55ca-021b-4d64-a79b-5d24220f3a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ec55ca-021b-4d64-a79b-5d24220f3a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6489d9f5-e3bb-4db4-b8fd-767d8d3eece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6489d9f5-e3bb-4db4-b8fd-767d8d3eece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9160429f-3a6a-4bb7-b30e-06e262e717b6', 'volume_name': 'volume-9160429f-3a6a-4bb7-b30e-06e262e717b6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9e0668-16f0-4172-a68e-1c8c96ecd241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9e0668-16f0-4172-a68e-1c8c96ecd241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d0f980-d7ca-4c9e-b681-2b11692669fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume 9160429f-3a6a-4bb7-b30e-06e262e717b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9160429f-3a6a-4bb7-b30e-06e262e717b6', 'volume_size': 1} Sep 25 16:18:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:40 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10 1073741824" returned: 0 in 1.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:40 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10 Sep 25 16:18:40 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (09804c04-0e0e-41d8-acb3-29ecbf472549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3666bfea-5e71-4b90-8257-932cf81a7a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3666bfea-5e71-4b90-8257-932cf81a7a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042909105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cfda25-ba8c-438b-8a0e-b2c524c4f4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:40Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbc7c13-57ff-446f-8b9f-c6b7b9255a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbc7c13-57ff-446f-8b9f-c6b7b9255a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73949dbc-4aad-4b86-87de-bd043d88853c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73949dbc-4aad-4b86-87de-bd043d88853c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58cfda25-ba8c-438b-8a0e-b2c524c4f4e2', 'volume_name': 'volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9ff02b-62c2-401f-855e-98a6914f6b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9ff02b-62c2-401f-855e-98a6914f6b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a92e3c4-ee33-43ce-a216-562313e0b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:40 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume 58cfda25-ba8c-438b-8a0e-b2c524c4f4e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2', 'volume_size': 1} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10" returned: 0 in 0.488s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1077652535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1677c11-332e-44cd-9707-27d529ffd843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:39Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Creating volume b1677c11-332e-44cd-9707-27d529ffd843 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:40 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ed162f-911e-48a3-b542-4bbd09f19558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423e84ff-1def-450f-a966-427debdb1e10', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3224c2a7-b34b-42d0-8b44-b93df2f6f475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:40 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843 1073741824 Sep 25 16:18:40 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume volume-423e84ff-1def-450f-a966-427debdb1e10 (423e84ff-1def-450f-a966-427debdb1e10): created successfully Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3224c2a7-b34b-42d0-8b44-b93df2f6f475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (1b7c5659-550e-469f-8277-f7ce0ebafa07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-aec7194d-b64d-47e7-81f7-20b93050da26 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created volume successfully. Sep 25 16:18:41 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843 1073741824" returned: 0 in 1.115s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:41 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843 Sep 25 16:18:41 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:42 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.365s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1437842690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9160429f-3a6a-4bb7-b30e-06e262e717b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:40Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Creating volume 9160429f-3a6a-4bb7-b30e-06e262e717b6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:42 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:42 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 1073741824 Sep 25 16:18:42 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8931930-7090-4336-80c5-9c254eb106da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1677c11-332e-44cd-9707-27d529ffd843', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e6dd4b-bc56-496c-934f-48e12bf4b9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume volume-b1677c11-332e-44cd-9707-27d529ffd843 (b1677c11-332e-44cd-9707-27d529ffd843): created successfully Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e6dd4b-bc56-496c-934f-48e12bf4b9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (8344d510-ec2c-4ef6-985d-bc95fa745eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b30e08af-bae2-4f0f-8cc8-f2a054b46111 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created volume successfully. Sep 25 16:18:43 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 1073741824" returned: 0 in 1.331s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:43 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 Sep 25 16:18:43 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:44 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6" returned: 0 in 0.927s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] <== create_volume: return (2387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042909105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cfda25-ba8c-438b-8a0e-b2c524c4f4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa6f11ea46a4a12a1a88b57aed9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:40Z,use_quota=True,user_id='71aa210bcdb7452bbe7fc300b0924888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Creating volume 58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:44 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d0f980-d7ca-4c9e-b681-2b11692669fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9160429f-3a6a-4bb7-b30e-06e262e717b6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:44 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 1073741824 Sep 25 16:18:44 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ea844d-153e-4a1b-b16a-5c73ba1fbc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 (9160429f-3a6a-4bb7-b30e-06e262e717b6): created successfully Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ea844d-153e-4a1b-b16a-5c73ba1fbc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (51740851-0519-4a84-853d-e863441c279c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1c0da3bb-a42d-4422-903c-ab74bd58571e tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created volume successfully. Sep 25 16:18:45 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 1073741824" returned: 0 in 0.846s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:45 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 Sep 25 16:18:45 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:46 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2" returned: 0 in 0.781s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a92e3c4-ee33-43ce-a216-562313e0b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb763b50-0fa5-421d-bcf7-1f774e6f04da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Volume volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 (58cfda25-ba8c-438b-8a0e-b2c524c4f4e2): created successfully Sep 25 16:18:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb763b50-0fa5-421d-bcf7-1f774e6f04da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Flow 'volume_create_manager' (09804c04-0e0e-41d8-acb3-29ecbf472549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dfe8c468-13f9-4044-9acd-313039b5216a tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created volume successfully. Sep 25 16:18:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-quobyte-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5ef58e-9cc3-43a9-8856-3d70b34ca1e4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:47 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 Sep 25 16:18:47 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:47 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2" returned: 0 in 0.717s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:48 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2 Sep 25 16:18:48 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:48 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2" returned: 0 in 0.804s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2" released by "delete_volume" :: held 1.623s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:48 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created reservations ['968ddc72-bb33-4afb-970f-57b75c53ef09', 'c8803bc9-bc26-4aa1-b821-ae1b19e90e7a', '93a5e610-caad-48b9-ac76-73984e8274ae', '2ad3e3f9-5ec2-4acc-a870-a67c71f3f830'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:49 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:18:49 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:49 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.436s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Deleted volume successfully. Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29326d17-02da-4baf-9ab3-986736b99d2f tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-58cfda25-ba8c-438b-8a0e-b2c524c4f4e2-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-9160429f-3a6a-4bb7-b30e-06e262e717b6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-9160429f-3a6a-4bb7-b30e-06e262e717b6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-quobyte-9160429f-3a6a-4bb7-b30e-06e262e717b6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-9160429f-3a6a-4bb7-b30e-06e262e717b6" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d970d7d-e0a9-48f2-a633-c766f9e98bf4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:50 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 Sep 25 16:18:50 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:50 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6" returned: 0 in 0.790s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:50 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6 Sep 25 16:18:50 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:51 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9160429f-3a6a-4bb7-b30e-06e262e717b6" returned: 0 in 0.830s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-9160429f-3a6a-4bb7-b30e-06e262e717b6" released by "delete_volume" :: held 1.741s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:51 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created reservations ['a5809882-442f-4970-8394-5fb22a709db7', '9d2c146d-b72e-4814-bbe9-a3199d1b5672', '65e45257-2f5b-4584-a963-f9f16d2b4b3d', '9e9ea5a8-2d48-4baf-b4aa-7d3ce3d5962a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:51 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:18:51 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-b1677c11-332e-44cd-9707-27d529ffd843-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-b1677c11-332e-44cd-9707-27d529ffd843-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:52 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.732s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:52 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Deleted volume successfully. Sep 25 16:18:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0255b724-48d7-4763-b228-419ef411e6f0 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-9160429f-3a6a-4bb7-b30e-06e262e717b6-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-quobyte-b1677c11-332e-44cd-9707-27d529ffd843" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-b1677c11-332e-44cd-9707-27d529ffd843" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cc7719-3f47-4651-9534-a17a958a1304]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:53 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843 Sep 25 16:18:53 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:53 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843" returned: 0 in 0.677s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:53 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843 Sep 25 16:18:53 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:54 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1677c11-332e-44cd-9707-27d529ffd843" returned: 0 in 0.622s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-b1677c11-332e-44cd-9707-27d529ffd843" released by "delete_volume" :: held 1.380s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created reservations ['138ad997-2063-4e60-85cf-4422eb44e24e', '81e25c7b-ee1d-487b-9181-449b2e636fe6', '8dfc9623-f474-4bf8-b5c0-8d9dff2a811b', '0a32dbb1-db09-4e8a-99da-5518c60a74d8'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:54 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:18:54 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:54 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Deleted volume successfully. Sep 25 16:18:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-08e7fea1-2d88-4c8b-baee-6c0f397f1220 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-b1677c11-332e-44cd-9707-27d529ffd843-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-423e84ff-1def-450f-a966-427debdb1e10-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-423e84ff-1def-450f-a966-427debdb1e10-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-quobyte-423e84ff-1def-450f-a966-427debdb1e10" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-423e84ff-1def-450f-a966-427debdb1e10" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2157a1b-07ea-4bdb-9cc4-7db665932348]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:55 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10 Sep 25 16:18:55 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:55 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10" returned: 0 in 0.635s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:56 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10 Sep 25 16:18:56 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:56 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-423e84ff-1def-450f-a966-427debdb1e10" returned: 0 in 0.341s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-423e84ff-1def-450f-a966-427debdb1e10" released by "delete_volume" :: held 1.068s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created reservations ['fba41005-510d-4550-9df2-9c05a6d763e8', 'f5e7c0a2-6718-401d-928d-0ee9b041b5c9', '4acc55a9-c880-43a3-b152-661c6bbf9ea3', '33932b18-90ad-401d-a560-2f1f27d25598'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:56 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:18:56 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:56 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.317s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Deleted volume successfully. Sep 25 16:18:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ff86596b-650c-46b3-a853-8eb71d8d8070 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-423e84ff-1def-450f-a966-427debdb1e10-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-995e58bc-06c8-40d7-8b62-b07d7a8f17aa-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-995e58bc-06c8-40d7-8b62-b07d7a8f17aa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-quobyte-995e58bc-06c8-40d7-8b62-b07d7a8f17aa" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-995e58bc-06c8-40d7-8b62-b07d7a8f17aa" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f144fbff-de59-4e80-9339-f545e074aab0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:57 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa Sep 25 16:18:57 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:58 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:58 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa Sep 25 16:18:58 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:58 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-995e58bc-06c8-40d7-8b62-b07d7a8f17aa" returned: 0 in 0.307s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-995e58bc-06c8-40d7-8b62-b07d7a8f17aa" released by "delete_volume" :: held 0.791s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created reservations ['b0d67bed-6eb4-403d-ae88-b1261ca82011', '2c4d3cfe-5df6-433b-a025-43d97f559e5f', '1e486ea8-d173-4c90-baa6-d866fa5fbec8', '11ece739-c17c-447a-ab0a-47eb275340a1'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:58 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:18:58 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:58 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:18:58 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-2c32a2d7-fc2d-432c-a589-35a418061c6f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-2c32a2d7-fc2d-432c-a589-35a418061c6f-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "cinder-quobyte-2c32a2d7-fc2d-432c-a589-35a418061c6f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-2c32a2d7-fc2d-432c-a589-35a418061c6f" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:59 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[113b7528-b039-4ff6-8519-696c37ddc5f4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.708s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:18:59 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.809s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Deleted volume successfully. Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51bbb745-124c-40b7-8c7b-aecbf0b352ef tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-995e58bc-06c8-40d7-8b62-b07d7a8f17aa-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:59 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f Sep 25 16:18:59 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:59 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f" returned: 0 in 0.573s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:59 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f Sep 25 16:18:59 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:00 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2c32a2d7-fc2d-432c-a589-35a418061c6f" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-quobyte-2c32a2d7-fc2d-432c-a589-35a418061c6f" released by "delete_volume" :: held 1.007s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Created reservations ['27f60118-814a-431a-8af1-34cecd31bc38', '7bc8fbc7-1841-4796-86a7-823695a198ec', 'c0ac5151-7bb0-420e-80eb-e304d50e6199', '56b862ec-b164-4fca-bf51-23a134f9fd88'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:00 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:19:00 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:01 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.530s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Deleted volume successfully. Sep 25 16:19:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ab167ac-cabe-4aee-8674-03bfe74852b8 tempest-CreateVolumesFromSourceVolumeTest-77038075 None] Lock "cinder-2c32a2d7-fc2d-432c-a589-35a418061c6f-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Flow 'volume_create_manager' (e2e6e032-8f2f-4792-9ba7-271d0cadbe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc76847f-df62-41b5-9413-d51a1fc5920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc76847f-df62-41b5-9413-d51a1fc5920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1209928581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d9258e-2dfb-4b5d-8265-5988fc81a895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496068ce77da4c7f802f76fe818ab4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:06Z,use_quota=True,user_id='fb780dc9d2be4b0d8dce05c076bd2cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a6cff8b-f5f8-482a-bcc3-6b329c447b65),volume_type_id=2a6cff8b-f5f8-482a-bcc3-6b329c447b65)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aef73e0-4283-4306-98e5-ab0eea44157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aef73e0-4283-4306-98e5-ab0eea44157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0760908b-f6d7-4158-9e0e-fd867c29a6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0760908b-f6d7-4158-9e0e-fd867c29a6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d9258e-2dfb-4b5d-8265-5988fc81a895', 'volume_name': 'volume-28d9258e-2dfb-4b5d-8265-5988fc81a895', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d71891-14cb-4435-86f9-4b7ac08910be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d71891-14cb-4435-86f9-4b7ac08910be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc42483-209f-4910-ad52-1b6e7476b657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Volume 28d9258e-2dfb-4b5d-8265-5988fc81a895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d9258e-2dfb-4b5d-8265-5988fc81a895', 'volume_size': 1} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1209928581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d9258e-2dfb-4b5d-8265-5988fc81a895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496068ce77da4c7f802f76fe818ab4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:06Z,use_quota=True,user_id='fb780dc9d2be4b0d8dce05c076bd2cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a6cff8b-f5f8-482a-bcc3-6b329c447b65),volume_type_id=2a6cff8b-f5f8-482a-bcc3-6b329c447b65)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Creating volume 28d9258e-2dfb-4b5d-8265-5988fc81a895 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:06 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:19:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:06 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 1073741824 Sep 25 16:19:06 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:07 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Flow 'volume_create_manager' (dd0cf7b7-fc73-41e7-b7d0-1df01ece9521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61fabb5a-68c6-48a3-a320-3ec08b05a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 1073741824" returned: 0 in 0.894s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61fabb5a-68c6-48a3-a320-3ec08b05a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1361845483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8937eaff-5961-4f23-a8a5-85c09cbd050f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc38dd4c071749b1bd97144dcce16abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:07Z,use_quota=True,user_id='8bf6077e61d344ee94989142dff0dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd49dba-1330-4132-b5d5-c7ce194743cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd49dba-1330-4132-b5d5-c7ce194743cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcf9273-e177-428b-bda1-b00f4dc883af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcf9273-e177-428b-bda1-b00f4dc883af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8937eaff-5961-4f23-a8a5-85c09cbd050f', 'volume_name': 'volume-8937eaff-5961-4f23-a8a5-85c09cbd050f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5ecde1-430e-43e1-8c28-aff7ac611ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5ecde1-430e-43e1-8c28-aff7ac611ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd9fe80-7110-46f2-86c1-2f598d5d5cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Volume 8937eaff-5961-4f23-a8a5-85c09cbd050f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8937eaff-5961-4f23-a8a5-85c09cbd050f', 'volume_size': 1} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Flow 'volume_create_manager' (102d35e3-4205-4fd8-9099-d9c1a8693e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72de9694-d5c8-4d6d-bd5d-2a183ab1c03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72de9694-d5c8-4d6d-bd5d-2a183ab1c03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-770500354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f8c0cf-f05a-4be4-bb46-76971c63089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496068ce77da4c7f802f76fe818ab4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:07Z,use_quota=True,user_id='fb780dc9d2be4b0d8dce05c076bd2cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21498f5c-83cc-4af3-aa57-fea0a37e0b40),volume_type_id=21498f5c-83cc-4af3-aa57-fea0a37e0b40)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1cef00-7fa8-4ddd-ab27-36728c477c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1cef00-7fa8-4ddd-ab27-36728c477c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09b53da-d126-4ba2-8751-de56d3a1b6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09b53da-d126-4ba2-8751-de56d3a1b6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72f8c0cf-f05a-4be4-bb46-76971c63089a', 'volume_name': 'volume-72f8c0cf-f05a-4be4-bb46-76971c63089a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76e3541-1d10-4680-93e0-a1fed0547370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76e3541-1d10-4680-93e0-a1fed0547370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714eff25-d2d3-4a5b-bafc-deb735a21de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Volume 72f8c0cf-f05a-4be4-bb46-76971c63089a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72f8c0cf-f05a-4be4-bb46-76971c63089a', 'volume_size': 1} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:07 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 Sep 25 16:19:07 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Flow 'volume_create_manager' (8d2f9fec-4a57-47e0-92a0-fa1f45885352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40d2d5f-55aa-4d60-8667-255172231b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:08 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895" returned: 0 in 0.408s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1361845483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8937eaff-5961-4f23-a8a5-85c09cbd050f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc38dd4c071749b1bd97144dcce16abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:07Z,use_quota=True,user_id='8bf6077e61d344ee94989142dff0dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Creating volume 8937eaff-5961-4f23-a8a5-85c09cbd050f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40d2d5f-55aa-4d60-8667-255172231b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-912351231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef676f57-82ff-48b4-a0b5-05e975a3f943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496068ce77da4c7f802f76fe818ab4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:08Z,use_quota=True,user_id='fb780dc9d2be4b0d8dce05c076bd2cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b429101-29a7-4824-b0a9-a32ce690354a),volume_type_id=2b429101-29a7-4824-b0a9-a32ce690354a)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb86a20a-a459-451d-90b8-66c489d3adfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:08 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f 1073741824 Sep 25 16:19:08 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb86a20a-a459-451d-90b8-66c489d3adfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422d638f-547a-47ce-95d1-b3b087eda920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc42483-209f-4910-ad52-1b6e7476b657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d9258e-2dfb-4b5d-8265-5988fc81a895', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af5e9d3-24ec-4e3d-b759-169f448a0cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Volume volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 (28d9258e-2dfb-4b5d-8265-5988fc81a895): created successfully Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af5e9d3-24ec-4e3d-b759-169f448a0cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Flow 'volume_create_manager' (e2e6e032-8f2f-4792-9ba7-271d0cadbe7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c996e44d-390c-4565-a311-c24e03d5a9c5 tempest-TestInstancesWithCinderVolumes-256537226 None] Created volume successfully. Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422d638f-547a-47ce-95d1-b3b087eda920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef676f57-82ff-48b4-a0b5-05e975a3f943', 'volume_name': 'volume-ef676f57-82ff-48b4-a0b5-05e975a3f943', 'volume_size': 1, 'image_id': 'b8e86987-ad8a-43b6-8d84-af6576e660f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8e86987-ad8a-43b6-8d84-af6576e660f7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1847646949', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '496068ce77da4c7f802f76fe818ab4f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8e86987-ad8a-43b6-8d84-af6576e660f7', 'created_at': datetime.datetime(2026, 9, 25, 14, 19, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 19, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8e86987-ad8a-43b6-8d84-af6576e660f7/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64be9d1-d8e7-4cc9-a83e-24f65f1316e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64be9d1-d8e7-4cc9-a83e-24f65f1316e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a392c0-f250-4b19-a32c-1258d91c4793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Volume ef676f57-82ff-48b4-a0b5-05e975a3f943: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef676f57-82ff-48b4-a0b5-05e975a3f943', 'volume_size': 1, 'image_id': 'b8e86987-ad8a-43b6-8d84-af6576e660f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8e86987-ad8a-43b6-8d84-af6576e660f7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1847646949', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '496068ce77da4c7f802f76fe818ab4f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8e86987-ad8a-43b6-8d84-af6576e660f7', 'created_at': datetime.datetime(2026, 9, 25, 14, 19, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 19, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8e86987-ad8a-43b6-8d84-af6576e660f7/file', 'properties': {}}, 'image_service': } Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Trying to clone ef676f57-82ff-48b4-a0b5-05e975a3f943 from image b8e86987-ad8a-43b6-8d84-af6576e660f7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8e86987-ad8a-43b6-8d84-af6576e660f7', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:19:08 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f 1073741824" returned: 0 in 0.784s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:09 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f Sep 25 16:19:09 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:09 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-770500354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f8c0cf-f05a-4be4-bb46-76971c63089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496068ce77da4c7f802f76fe818ab4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:07Z,use_quota=True,user_id='fb780dc9d2be4b0d8dce05c076bd2cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21498f5c-83cc-4af3-aa57-fea0a37e0b40),volume_type_id=21498f5c-83cc-4af3-aa57-fea0a37e0b40)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Creating volume 72f8c0cf-f05a-4be4-bb46-76971c63089a {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:09 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd9fe80-7110-46f2-86c1-2f598d5d5cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8937eaff-5961-4f23-a8a5-85c09cbd050f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:09 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a 1073741824 Sep 25 16:19:09 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215fe843-8e33-473c-a843-793f351a2000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Volume volume-8937eaff-5961-4f23-a8a5-85c09cbd050f (8937eaff-5961-4f23-a8a5-85c09cbd050f): created successfully Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215fe843-8e33-473c-a843-793f351a2000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Flow 'volume_create_manager' (dd0cf7b7-fc73-41e7-b7d0-1df01ece9521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9e9e7038-5c15-4648-ab29-1a0eab3f34cb tempest-AttachVolumeNegativeTest-162056123 None] Created volume successfully. Sep 25 16:19:10 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a 1073741824" returned: 0 in 0.755s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:10 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a Sep 25 16:19:10 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:10 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a" returned: 0 in 0.465s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714eff25-d2d3-4a5b-bafc-deb735a21de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f8c0cf-f05a-4be4-bb46-76971c63089a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc593aff-7da8-4815-aab9-2d68f29a0dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:10 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Volume volume-72f8c0cf-f05a-4be4-bb46-76971c63089a (72f8c0cf-f05a-4be4-bb46-76971c63089a): created successfully Sep 25 16:19:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc593aff-7da8-4815-aab9-2d68f29a0dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Flow 'volume_create_manager' (102d35e3-4205-4fd8-9099-d9c1a8693e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-28d238a0-ecf3-4451-a398-42f7bc9bd69f tempest-TestInstancesWithCinderVolumes-256537226 None] Created volume successfully. Sep 25 16:19:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e503ad15-980d-410a-b4b4-eb0c07719215 req-f30bade8-fd5d-4ad1-ad79-b9fcc6a63d66 tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e503ad15-980d-410a-b4b4-eb0c07719215 req-f30bade8-fd5d-4ad1-ad79-b9fcc6a63d66 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e503ad15-980d-410a-b4b4-eb0c07719215 req-f30bade8-fd5d-4ad1-ad79-b9fcc6a63d66 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-e503ad15-980d-410a-b4b4-eb0c07719215 req-f30bade8-fd5d-4ad1-ad79-b9fcc6a63d66 tempest-AttachVolumeNegativeTest-162056123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-8937eaff-5961-4f23-a8a5-85c09cbd050f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48d08809-9bf6-45ad-bf57-a23a2a5df242', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:19:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-e503ad15-980d-410a-b4b4-eb0c07719215 req-f30bade8-fd5d-4ad1-ad79-b9fcc6a63d66 tempest-AttachVolumeNegativeTest-162056123 None] attachment_update completed successfully. Sep 25 16:19:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-3c77d412-4383-4e49-a590-668d335231ee req-f01ade63-149a-4bd8-a285-9619fc9c0c3e tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-3c77d412-4383-4e49-a590-668d335231ee req-f01ade63-149a-4bd8-a285-9619fc9c0c3e tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-3c77d412-4383-4e49-a590-668d335231ee req-f01ade63-149a-4bd8-a285-9619fc9c0c3e tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-3c77d412-4383-4e49-a590-668d335231ee req-f01ade63-149a-4bd8-a285-9619fc9c0c3e tempest-TestServerVolumeAttachmentScenario-204688708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-3ac5ccc1-8419-475d-81db-396bcb501fa0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3ef7edf-3c29-4aea-8754-8c05395a3587', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:19:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-3c77d412-4383-4e49-a590-668d335231ee req-f01ade63-149a-4bd8-a285-9619fc9c0c3e tempest-TestServerVolumeAttachmentScenario-204688708 None] attachment_update completed successfully. Sep 25 16:19:14 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD, size 20.69 MB, duration 5.80 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:19:14 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Image download 20.69 MB at 3.57 MB/s Sep 25 16:19:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[88667f08-4d7f-49d6-9b48-6009162f1661]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:14 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD Sep 25 16:19:14 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:15 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Temporary image b8e86987-ad8a-43b6-8d84-af6576e660f7 is fetched for user fb780dc9d2be4b0d8dce05c076bd2cf1. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[454176c9-41a9-462c-b227-0504769bb107]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-3b18e834-539b-4228-b14b-90a44bba49ce req-ce87f375-ff3a-4634-91b6-22b10f0af5a1 tempest-AttachVolumeNegativeTest-162056123 None] Terminate volume connection completed successfully. Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-3b18e834-539b-4228-b14b-90a44bba49ce req-ce87f375-ff3a-4634-91b6-22b10f0af5a1 tempest-AttachVolumeNegativeTest-162056123 None] Deleting attachment 48d08809-9bf6-45ad-bf57-a23a2a5df242. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:19:15 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD Sep 25 16:19:15 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:15 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-912351231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef676f57-82ff-48b4-a0b5-05e975a3f943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496068ce77da4c7f802f76fe818ab4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:08Z,use_quota=True,user_id='fb780dc9d2be4b0d8dce05c076bd2cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b429101-29a7-4824-b0a9-a32ce690354a),volume_type_id=2b429101-29a7-4824-b0a9-a32ce690354a)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Creating volume ef676f57-82ff-48b4-a0b5-05e975a3f943 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:15 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:19:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:15 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 1073741824 Sep 25 16:19:15 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 1073741824" returned: 0 in 0.634s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:16 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:16 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 Sep 25 16:19:16 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:16 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943" returned: 0 in 0.437s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:16 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Attempting download of b8e86987-ad8a-43b6-8d84-af6576e660f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8e86987-ad8a-43b6-8d84-af6576e660f7', 'metadata': {}}])) to volume ef676f57-82ff-48b4-a0b5-05e975a3f943. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:19:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b1fe7a-2638-4783-95f2-15226b1c95a6]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8e86987-ad8a-43b6-8d84-af6576e660f7_0bvfstnx {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:17 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8e86987-ad8a-43b6-8d84-af6576e660f7_0bvfstnx Sep 25 16:19:17 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:17 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8e86987-ad8a-43b6-8d84-af6576e660f7_0bvfstnx" returned: 0 in 0.625s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8e86987-ad8a-43b6-8d84-af6576e660f7_0bvfstnx {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:17 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8e86987-ad8a-43b6-8d84-af6576e660f7_0bvfstnx Sep 25 16:19:17 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:18 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8e86987-ad8a-43b6-8d84-af6576e660f7_0bvfstnx" returned: 1 in 0.606s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8e86987-ad8a-43b6-8d84-af6576e660f7_0bvfstnx' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:19:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9246eb3a-3154-4990-aaf0-b915f09b7e23]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:18 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD Sep 25 16:19:18 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:18 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:18 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87314) copy_or_move_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1011}} Sep 25 16:19:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 iflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:19 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 iflag=direct Sep 25 16:19:19 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:19 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 iflag=direct" returned: 0 in 0.481s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:19 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 oflag=direct Sep 25 16:19:19 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:19 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 oflag=direct" returned: 0 in 0.441s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:19 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:19:19 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-056d777c-a600-4f8a-a79f-9ab1c75386e7 req-db686634-eaac-486f-ab46-fd33f787fc19 tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-056d777c-a600-4f8a-a79f-9ab1c75386e7 req-db686634-eaac-486f-ab46-fd33f787fc19 tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-056d777c-a600-4f8a-a79f-9ab1c75386e7 req-db686634-eaac-486f-ab46-fd33f787fc19 tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-056d777c-a600-4f8a-a79f-9ab1c75386e7 req-db686634-eaac-486f-ab46-fd33f787fc19 tempest-TestServerVolumeAttachmentScenario-204688708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-6feafd15-9823-4781-93d8-e5d7de3b84da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4e61672-f37b-46d3-9c2e-6f13548ac747', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:19:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-056d777c-a600-4f8a-a79f-9ab1c75386e7 req-db686634-eaac-486f-ab46-fd33f787fc19 tempest-TestServerVolumeAttachmentScenario-204688708 None] attachment_update completed successfully. Sep 25 16:19:20 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 0.955s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:20 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_b8e86987-ad8a-43b6-8d84-af6576e660f7_xwjpumnadevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943, size 21.00 MB, duration 1.00 sec {{(pid=87314) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:19:20 devstack cinder-volume[87314]: INFO cinder.volume.volume_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Volume copy 21.00 MB at 21.00 MB/s Sep 25 16:19:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:20 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 1G Sep 25 16:19:20 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:21 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 1G" returned: 0 in 0.618s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Downloaded image b8e86987-ad8a-43b6-8d84-af6576e660f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8e86987-ad8a-43b6-8d84-af6576e660f7', 'metadata': {}}])) to volume ef676f57-82ff-48b4-a0b5-05e975a3f943 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Temporary image b8e86987-ad8a-43b6-8d84-af6576e660f7 for user fb780dc9d2be4b0d8dce05c076bd2cf1 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Marking volume ef676f57-82ff-48b4-a0b5-05e975a3f943 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Copying metadata from image b8e86987-ad8a-43b6-8d84-af6576e660f7 to ef676f57-82ff-48b4-a0b5-05e975a3f943. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Creating volume glance metadata for volume ef676f57-82ff-48b4-a0b5-05e975a3f943 backed by image b8e86987-ad8a-43b6-8d84-af6576e660f7 with: {'image_id': 'b8e86987-ad8a-43b6-8d84-af6576e660f7', 'image_name': 'tempest-scenario-img--1847646949', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a392c0-f250-4b19-a32c-1258d91c4793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef676f57-82ff-48b4-a0b5-05e975a3f943', 'volume_size': 1, 'image_id': 'b8e86987-ad8a-43b6-8d84-af6576e660f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8e86987-ad8a-43b6-8d84-af6576e660f7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1847646949', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '496068ce77da4c7f802f76fe818ab4f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8e86987-ad8a-43b6-8d84-af6576e660f7', 'created_at': datetime.datetime(2026, 9, 25, 14, 19, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 19, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8e86987-ad8a-43b6-8d84-af6576e660f7/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18e1e4a-fac3-4e59-a48d-a4ee257f9e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:21 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Volume volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 (ef676f57-82ff-48b4-a0b5-05e975a3f943): created successfully Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18e1e4a-fac3-4e59-a48d-a4ee257f9e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Flow 'volume_create_manager' (8d2f9fec-4a57-47e0-92a0-fa1f45885352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d20d8a9e-215c-43e2-9533-d038270d0811 tempest-TestInstancesWithCinderVolumes-256537226 None] Created volume successfully. Sep 25 16:19:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-b70ef4d1-2b3a-4635-94e3-661059c26092 req-0b730f04-de75-491d-aaef-45b5e80405a0 tempest-TestServerVolumeAttachmentScenario-204688708 None] Terminate volume connection completed successfully. Sep 25 16:19:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-b70ef4d1-2b3a-4635-94e3-661059c26092 req-0b730f04-de75-491d-aaef-45b5e80405a0 tempest-TestServerVolumeAttachmentScenario-204688708 None] Deleting attachment c4e61672-f37b-46d3-9c2e-6f13548ac747. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:19:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-8ff88263-8e47-4c61-a999-e18e66cd6e5f req-b8ad4dd8-463e-46ad-8b7f-c88e363cc628 tempest-TestServerVolumeAttachmentScenario-204688708 None] Terminate volume connection completed successfully. Sep 25 16:19:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-8ff88263-8e47-4c61-a999-e18e66cd6e5f req-b8ad4dd8-463e-46ad-8b7f-c88e363cc628 tempest-TestServerVolumeAttachmentScenario-204688708 None] Deleting attachment f3ef7edf-3c29-4aea-8754-8c05395a3587. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:19:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d06e3d46-9981-445d-ba23-299c867fd748 req-1041f830-d5ec-43f1-b4e1-059165f31a16 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d06e3d46-9981-445d-ba23-299c867fd748 req-1041f830-d5ec-43f1-b4e1-059165f31a16 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d06e3d46-9981-445d-ba23-299c867fd748 req-1041f830-d5ec-43f1-b4e1-059165f31a16 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d06e3d46-9981-445d-ba23-299c867fd748 req-1041f830-d5ec-43f1-b4e1-059165f31a16 tempest-TestInstancesWithCinderVolumes-256537226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-ef676f57-82ff-48b4-a0b5-05e975a3f943', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef124fd6-a53c-4989-9a61-8ee9780a204e', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:19:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-d06e3d46-9981-445d-ba23-299c867fd748 req-1041f830-d5ec-43f1-b4e1-059165f31a16 tempest-TestInstancesWithCinderVolumes-256537226 None] attachment_update completed successfully. Sep 25 16:19:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "cinder-6feafd15-9823-4781-93d8-e5d7de3b84da-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "cinder-6feafd15-9823-4781-93d8-e5d7de3b84da-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:37 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=88,cinder:SELECT=77,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:19:37 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=94,cinder:INSERT=25,cinder:UPDATE=85,cinder:DELETE=10 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:19:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "cinder-quobyte-6feafd15-9823-4781-93d8-e5d7de3b84da" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "cinder-quobyte-6feafd15-9823-4781-93d8-e5d7de3b84da" acquired by "delete_volume" :: waited 0.054s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e663f3b3-61c8-4ed4-afc2-a7eaa5f23820]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:37 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da Sep 25 16:19:37 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:38 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da" returned: 0 in 0.745s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:38 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da Sep 25 16:19:38 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:38 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6feafd15-9823-4781-93d8-e5d7de3b84da" returned: 0 in 0.464s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "cinder-quobyte-6feafd15-9823-4781-93d8-e5d7de3b84da" released by "delete_volume" :: held 1.342s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Created reservations ['b5a25d11-c096-4488-b52c-31b78374122f', 'dda4639c-5ef0-44aa-b44a-6312c1dd236d', '68351506-a3f2-4e74-a0ed-a352004fde84', '01c54a08-8881-4ec9-9c46-d68e0c27d7ce'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:39 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:19:39 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:39 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.468s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Deleted volume successfully. Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dcc67003-2350-4a1b-b040-7f23807937ac tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "cinder-6feafd15-9823-4781-93d8-e5d7de3b84da-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "cinder-3ac5ccc1-8419-475d-81db-396bcb501fa0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "cinder-3ac5ccc1-8419-475d-81db-396bcb501fa0-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "cinder-quobyte-3ac5ccc1-8419-475d-81db-396bcb501fa0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "cinder-quobyte-3ac5ccc1-8419-475d-81db-396bcb501fa0" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b616de11-9d26-4e63-b2a3-8481bda4dbe9]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:40 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 Sep 25 16:19:40 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:40 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0" returned: 0 in 0.710s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:40 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0 Sep 25 16:19:40 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:41 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3ac5ccc1-8419-475d-81db-396bcb501fa0" returned: 0 in 0.540s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "cinder-quobyte-3ac5ccc1-8419-475d-81db-396bcb501fa0" released by "delete_volume" :: held 1.350s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:41 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Created reservations ['5ae8f2bd-9b8a-4ee3-80ad-e9c44428cf14', '8b76951e-c453-4e6d-a064-08ea17ea6cbc', '804a8114-995b-41dc-a679-da626e18c3ad', '8373730c-f957-4985-abc5-dabf91e74387'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:41 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:19:41 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:42 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.667s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:42 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Deleted volume successfully. Sep 25 16:19:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ce0afc0-5125-477b-8984-eaf9f293790e tempest-TestServerVolumeAttachmentScenario-204688708 None] Lock "cinder-3ac5ccc1-8419-475d-81db-396bcb501fa0-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Flow 'volume_create_manager' (55ae1b53-be08-4fe3-b1aa-5b185e47dd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983aa2dc-f483-49fa-a327-9ddda6820c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983aa2dc-f483-49fa-a327-9ddda6820c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1015404857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ab1470-fd29-4468-bc71-14af1d6ae1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd6edd3af0c4710a1ef8d4feef8e45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:44Z,use_quota=True,user_id='19e85324eff444a8b7391140eb30b424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bbbd63-59ef-4068-bc09-af4fa0b88925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bbbd63-59ef-4068-bc09-af4fa0b88925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab85f12d-d6f6-4e8f-abe1-9bbf177e7d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab85f12d-d6f6-4e8f-abe1-9bbf177e7d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ab1470-fd29-4468-bc71-14af1d6ae1cb', 'volume_name': 'volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f6c97b-d459-4719-bc09-64e73570ae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f6c97b-d459-4719-bc09-64e73570ae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f05a42f-dfe8-4f0c-9da9-5fdd58898427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Volume d7ab1470-fd29-4468-bc71-14af1d6ae1cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb', 'volume_size': 1} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1015404857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ab1470-fd29-4468-bc71-14af1d6ae1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd6edd3af0c4710a1ef8d4feef8e45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:44Z,use_quota=True,user_id='19e85324eff444a8b7391140eb30b424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Creating volume d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:44 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:19:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:44 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb 1073741824 Sep 25 16:19:44 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:46 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb 1073741824" returned: 0 in 1.647s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:46 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb Sep 25 16:19:46 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:47 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" returned: 0 in 0.998s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] <== create_volume: return (2831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.841s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f05a42f-dfe8-4f0c-9da9-5fdd58898427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f7665a-ba9a-478d-89ac-be1085e02fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Volume volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb (d7ab1470-fd29-4468-bc71-14af1d6ae1cb): created successfully Sep 25 16:19:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f7665a-ba9a-478d-89ac-be1085e02fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Flow 'volume_create_manager' (55ae1b53-be08-4fe3-b1aa-5b185e47dd1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b4b58993-1e58-4480-bac2-d414dafd5a17 tempest-SnapshotDependencyTests-1025030552 None] Created volume successfully. Sep 25 16:19:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Creating offline snapshot c404adc9-906f-4dca-993e-c23212c8d800 of volume d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:19:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7a992c-cefa-416d-8294-35863510e168]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:49 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb Sep 25 16:19:49 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:50 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" returned: 0 in 0.838s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:50 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 1G Sep 25 16:19:50 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:51 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 1G" returned: 0 in 0.765s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:51 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 Sep 25 16:19:51 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:52 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800" returned: 0 in 1.065s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:52 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 is being set with open permissions: ugo+rw Sep 25 16:19:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:52 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 Sep 25 16:19:52 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:52 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800" returned: 0 in 0.770s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:53 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.info Sep 25 16:19:53 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:53 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.info" returned: 0 in 0.790s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:53 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.info is being set with open permissions: ugo+rw Sep 25 16:19:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:54 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.info Sep 25 16:19:54 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:54 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.info" returned: 0 in 0.643s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.143s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-25a611ac-953e-4cfc-936f-2cf66bbe7f95 tempest-SnapshotDependencyTests-1025030552 None] Create snapshot completed successfully Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Flow 'volume_create_manager' (f8b44f82-bc6a-4c50-a247-104cf7dba06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017b5419-9e04-45f8-95ed-6017d6d38958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017b5419-9e04-45f8-95ed-6017d6d38958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c1532d-ef79-4815-91ee-fc15081332ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd6edd3af0c4710a1ef8d4feef8e45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c404adc9-906f-4dca-993e-c23212c8d800,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:56Z,use_quota=True,user_id='19e85324eff444a8b7391140eb30b424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b38f3bc-310d-4db5-9a32-9ff7fab6bb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b38f3bc-310d-4db5-9a32-9ff7fab6bb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79374b1-e4d1-4770-a98e-f416a9446f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79374b1-e4d1-4770-a98e-f416a9446f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9c1532d-ef79-4815-91ee-fc15081332ec', 'volume_name': 'volume-e9c1532d-ef79-4815-91ee-fc15081332ec', 'volume_size': 1, 'snapshot_id': 'c404adc9-906f-4dca-993e-c23212c8d800'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95dde38-dbb7-4c3f-98c3-2d7f780276b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95dde38-dbb7-4c3f-98c3-2d7f780276b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032384bb-b641-4080-8f9f-d16d90cc797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Volume e9c1532d-ef79-4815-91ee-fc15081332ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9c1532d-ef79-4815-91ee-fc15081332ec', 'volume_size': 1, 'snapshot_id': 'c404adc9-906f-4dca-993e-c23212c8d800'} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "cinder-quobyte-c404adc9-906f-4dca-993e-c23212c8d800-e9c1532d-ef79-4815-91ee-fc15081332ec" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-c404adc9-906f-4dca-993e-c23212c8d800-e9c1532d-ef79-4815-91ee-fc15081332ec" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Creating volume e9c1532d-ef79-4815-91ee-fc15081332ec from snapshot c404adc9-906f-4dca-993e-c23212c8d800 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "cinder-quobyte-e9c1532d-ef79-4815-91ee-fc15081332ec" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-e9c1532d-ef79-4815-91ee-fc15081332ec" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] snapshot: c404adc9-906f-4dca-993e-c23212c8d800, volume: e9c1532d-ef79-4815-91ee-fc15081332ec, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6abd81c-5d0a-446b-917d-2f2653d50f64]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:56 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 Sep 25 16:19:56 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:57 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800" returned: 0 in 1.058s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e66018-b1ac-41f9-ae9f-5133d652d675]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:58 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb Sep 25 16:19:58 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:58 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" returned: 0 in 0.846s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:58 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec Sep 25 16:19:58 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:58 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:19:58 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:59 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.458s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:19:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:19:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:20:06 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:06 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:10 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec" returned: 0 in 11.613s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb, size 1024.00 MB, duration 11.61 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:20:10 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Converted 1024.00 MB image at 88.17 MB/s Sep 25 16:20:10 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec is being set with open permissions: ugo+rw Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:10 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec Sep 25 16:20:10 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:10 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec" returned: 0 in 0.356s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-e9c1532d-ef79-4815-91ee-fc15081332ec" released by "_copy_volume_from_snapshot" :: held 14.062s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-c404adc9-906f-4dca-993e-c23212c8d800-e9c1532d-ef79-4815-91ee-fc15081332ec" released by "_create_volume_from_snapshot" :: held 14.185s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.245s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032384bb-b641-4080-8f9f-d16d90cc797d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c1532d-ef79-4815-91ee-fc15081332ec', 'volume_size': 1, 'snapshot_id': 'c404adc9-906f-4dca-993e-c23212c8d800'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd394a54-f120-402d-b2ff-cc46ba70dedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:10 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Volume volume-e9c1532d-ef79-4815-91ee-fc15081332ec (e9c1532d-ef79-4815-91ee-fc15081332ec): created successfully Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd394a54-f120-402d-b2ff-cc46ba70dedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Flow 'volume_create_manager' (f8b44f82-bc6a-4c50-a247-104cf7dba06d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6ae1fa39-e27a-42f0-9aef-348a09ba318f tempest-SnapshotDependencyTests-1025030552 None] Created volume successfully. Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "cinder-c404adc9-906f-4dca-993e-c23212c8d800-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-c404adc9-906f-4dca-993e-c23212c8d800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "cinder-quobyte-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "cinder-quobyte-c404adc9-906f-4dca-993e-c23212c8d800" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-c404adc9-906f-4dca-993e-c23212c8d800" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Deleting offline snapshot c404adc9-906f-4dca-993e-c23212c8d800 of volume d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] snapshot_file for this snap is: volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53c5567-6ad9-4d0d-803c-ae3d37ddf360]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:11 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 Sep 25 16:20:11 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:12 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800" returned: 0 in 0.617s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:20:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cf1552-0876-41c2-9416-c9966240295e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:12 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb Sep 25 16:20:12 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:12 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" returned: 0 in 0.709s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:12 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 Sep 25 16:20:12 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:13 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800" returned: 0 in 0.589s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:13 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800 Sep 25 16:20:13 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:13 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb.c404adc9-906f-4dca-993e-c23212c8d800" returned: 0 in 0.342s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-c404adc9-906f-4dca-993e-c23212c8d800" released by "_delete_snapshot" :: held 2.427s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" released by "delete_snapshot" :: held 2.479s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:13 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Created reservations ['44f05d0a-484b-45ac-bda8-857bb3770fb0', '8564ea39-095d-4f13-87ac-0afb1a1a8284', '5a7a94cb-15bd-465c-8828-c0d2d0e001fb', '5cac21d2-b536-42b9-b69a-d5555f288cad'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Delete snapshot completed successfully. Sep 25 16:20:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf6c1e4d-342c-43fe-a429-2bad713c87f1 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-c404adc9-906f-4dca-993e-c23212c8d800-delete_snapshot" released by "delete_snapshot" :: held 2.727s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "cinder-d7ab1470-fd29-4468-bc71-14af1d6ae1cb-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-d7ab1470-fd29-4468-bc71-14af1d6ae1cb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "cinder-quobyte-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[382d739c-af58-46b5-9351-2ffa37d201b6]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:15 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb Sep 25 16:20:15 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:15 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" returned: 0 in 0.695s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:15 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb Sep 25 16:20:15 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Flow 'volume_create_manager' (84243d4f-99cb-4abd-967b-7937e841d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39e5c39-cf53-4f93-986c-7ea0150f3c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39e5c39-cf53-4f93-986c-7ea0150f3c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-153001690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dabe6df-6a30-4513-99db-f3585279e537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891fb33a4a744e039a887a753524d914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:16Z,use_quota=True,user_id='fd99f2b138ec4674976d578433e4c6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71add31b-506e-49d1-89aa-38208665c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71add31b-506e-49d1-89aa-38208665c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc84cca-723b-4ef7-9c95-74a3375038a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc84cca-723b-4ef7-9c95-74a3375038a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dabe6df-6a30-4513-99db-f3585279e537', 'volume_name': 'volume-6dabe6df-6a30-4513-99db-f3585279e537', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d885896-1281-4b8f-95e4-6027e3f64320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d885896-1281-4b8f-95e4-6027e3f64320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df0243d-2dc6-43d4-8d81-b8818c18e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Volume 6dabe6df-6a30-4513-99db-f3585279e537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dabe6df-6a30-4513-99db-f3585279e537', 'volume_size': 1} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-153001690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dabe6df-6a30-4513-99db-f3585279e537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891fb33a4a744e039a887a753524d914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:16Z,use_quota=True,user_id='fd99f2b138ec4674976d578433e4c6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Creating volume 6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:16 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:16 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 1073741824 Sep 25 16:20:16 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:16 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" returned: 0 in 0.465s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-d7ab1470-fd29-4468-bc71-14af1d6ae1cb" released by "delete_volume" :: held 1.312s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-58e6cc2d-7a18-42fb-ac21-74beb9c429cf req-da57160f-6a0d-4317-88ad-96587d9bf172 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Created reservations ['78d06ccd-2954-46f2-9ac9-9a80c8653c68', '4aa548d5-189f-4514-83a1-da4a100b6237', '65743c7c-4d12-4b4c-94d3-7c9324eaeaca', '348cc745-a510-4075-82f2-eaeb8fb82d2d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:16 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:16 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:16 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 1073741824" returned: 0 in 0.610s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:16 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 Sep 25 16:20:16 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:16 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Deleted volume successfully. Sep 25 16:20:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9589deb6-0880-487d-9a57-a5b30a5c434d tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-d7ab1470-fd29-4468-bc71-14af1d6ae1cb-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:17 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-58e6cc2d-7a18-42fb-ac21-74beb9c429cf req-da57160f-6a0d-4317-88ad-96587d9bf172 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.724s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df0243d-2dc6-43d4-8d81-b8818c18e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dabe6df-6a30-4513-99db-f3585279e537', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854046e7-10e4-4074-b8c3-ec557a679034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-58e6cc2d-7a18-42fb-ac21-74beb9c429cf req-da57160f-6a0d-4317-88ad-96587d9bf172 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:17 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Volume volume-6dabe6df-6a30-4513-99db-f3585279e537 (6dabe6df-6a30-4513-99db-f3585279e537): created successfully Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854046e7-10e4-4074-b8c3-ec557a679034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Flow 'volume_create_manager' (84243d4f-99cb-4abd-967b-7937e841d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0ea71607-c5ad-457a-b06e-e43730697b93 tempest-VolumeDependencyTests-1748424908 None] Created volume successfully. Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "cinder-e9c1532d-ef79-4815-91ee-fc15081332ec-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-58e6cc2d-7a18-42fb-ac21-74beb9c429cf req-da57160f-6a0d-4317-88ad-96587d9bf172 tempest-TestInstancesWithCinderVolumes-256537226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-28d9258e-2dfb-4b5d-8265-5988fc81a895', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbe960bf-689a-45d7-a5e6-6a9d05ef490d', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-e9c1532d-ef79-4815-91ee-fc15081332ec-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "cinder-quobyte-e9c1532d-ef79-4815-91ee-fc15081332ec" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-58e6cc2d-7a18-42fb-ac21-74beb9c429cf req-da57160f-6a0d-4317-88ad-96587d9bf172 tempest-TestInstancesWithCinderVolumes-256537226 None] attachment_update completed successfully. Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-e9c1532d-ef79-4815-91ee-fc15081332ec" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdb5d71-0194-4ef6-ba8e-9c2dc0fe216f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:17 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec Sep 25 16:20:17 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:17 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec" returned: 0 in 0.420s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:17 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec Sep 25 16:20:17 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:17 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e9c1532d-ef79-4815-91ee-fc15081332ec" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-quobyte-e9c1532d-ef79-4815-91ee-fc15081332ec" released by "delete_volume" :: held 0.807s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Created reservations ['c90d5b17-664d-4646-b3b6-8e9396f0ea81', 'ae63f3c2-3b25-4a0f-8dc1-ed3711c019e4', 'cd694ba5-4cf1-4cad-ac36-e0bc0ed87c88', '9441de86-ffbc-450b-8de8-edc9654ea878'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:18 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:18 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Creating offline snapshot d7be1516-b9ee-4a84-80a4-d993afa4df37 of volume 6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc8fc87-3a93-4541-b821-64d39a03562f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:18 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 Sep 25 16:20:18 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:18 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Deleted volume successfully. Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-68671dd7-9f57-4d87-891a-2e1863daf2b8 tempest-SnapshotDependencyTests-1025030552 None] Lock "cinder-e9c1532d-ef79-4815-91ee-fc15081332ec-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:18 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537" returned: 0 in 0.483s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:18 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 1G Sep 25 16:20:18 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:19 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 1G" returned: 0 in 0.820s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dabe6df-6a30-4513-99db-f3585279e537 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:19 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dabe6df-6a30-4513-99db-f3585279e537 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 Sep 25 16:20:19 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Flow 'volume_create_manager' (dacbbd6d-5cd4-472f-9804-b0e6e676127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856653e3-6698-48d6-961e-e4fcdccec4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856653e3-6698-48d6-961e-e4fcdccec4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2077246154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe700dbe-fde1-4fa2-b539-16fd672f3ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc38dd4c071749b1bd97144dcce16abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:20Z,use_quota=True,user_id='8bf6077e61d344ee94989142dff0dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0e22fa-784c-4dc2-b752-68cd2bdde859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0e22fa-784c-4dc2-b752-68cd2bdde859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339c8fbd-4259-4d58-ac99-375389907595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339c8fbd-4259-4d58-ac99-375389907595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe700dbe-fde1-4fa2-b539-16fd672f3ac0', 'volume_name': 'volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1830db0e-32ee-4860-9d94-14ba4958e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1830db0e-32ee-4860-9d94-14ba4958e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:20 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad95876e-546c-4bea-8f01-e8980e30dea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Volume fe700dbe-fde1-4fa2-b539-16fd672f3ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0', 'volume_size': 1} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dabe6df-6a30-4513-99db-f3585279e537 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37" returned: 0 in 0.513s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:20 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 is being set with open permissions: ugo+rw Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:20 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 Sep 25 16:20:20 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-8904370c-05ec-4080-b301-e479743ca745 req-6f354e02-e00f-48c8-ae72-948ae0a49d1e tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:20 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37" returned: 0 in 0.270s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:20 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.info Sep 25 16:20:20 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:20 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.info" returned: 0 in 0.350s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:20 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.info is being set with open permissions: ugo+rw Sep 25 16:20:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:20 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.info Sep 25 16:20:20 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:21 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.info" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2077246154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe700dbe-fde1-4fa2-b539-16fd672f3ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc38dd4c071749b1bd97144dcce16abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:20Z,use_quota=True,user_id='8bf6077e61d344ee94989142dff0dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Creating volume fe700dbe-fde1-4fa2-b539-16fd672f3ac0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:21 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-186927d2-eb25-42e9-82d7-737a29d0d883 tempest-VolumeDependencyTests-1748424908 None] Create snapshot completed successfully Sep 25 16:20:21 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 1073741824 Sep 25 16:20:21 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:21 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 1073741824" returned: 0 in 0.631s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:21 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 Sep 25 16:20:21 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:22 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0" returned: 0 in 0.480s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-8904370c-05ec-4080-b301-e479743ca745 req-6f354e02-e00f-48c8-ae72-948ae0a49d1e tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.149s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad95876e-546c-4bea-8f01-e8980e30dea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2480f519-52ef-49b3-aef4-811cd5e330a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-8904370c-05ec-4080-b301-e479743ca745 req-6f354e02-e00f-48c8-ae72-948ae0a49d1e tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Volume volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 (fe700dbe-fde1-4fa2-b539-16fd672f3ac0): created successfully Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2480f519-52ef-49b3-aef4-811cd5e330a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Flow 'volume_create_manager' (dacbbd6d-5cd4-472f-9804-b0e6e676127a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-512d6d1e-9334-40c5-815d-21d4de2cd44f tempest-AttachVolumeNegativeTest-162056123 None] Created volume successfully. Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-8904370c-05ec-4080-b301-e479743ca745 req-6f354e02-e00f-48c8-ae72-948ae0a49d1e tempest-TestInstancesWithCinderVolumes-256537226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-72f8c0cf-f05a-4be4-bb46-76971c63089a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba3d70f3-85c7-458f-88f2-47d10a3a8626', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Flow 'volume_create_manager' (dde93d35-675b-448d-8ef5-103d0548c3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15102174-9857-4320-a61c-51ce97de2ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15102174-9857-4320-a61c-51ce97de2ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-356409688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fe8dc3-c901-4d8c-9e83-127660e21727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891fb33a4a744e039a887a753524d914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7be1516-b9ee-4a84-80a4-d993afa4df37,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:23Z,use_quota=True,user_id='fd99f2b138ec4674976d578433e4c6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451ff7aa-64eb-4a79-930d-1beab7e3df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451ff7aa-64eb-4a79-930d-1beab7e3df8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e965c51d-af19-4368-9042-71c73bf97b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e965c51d-af19-4368-9042-71c73bf97b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04fe8dc3-c901-4d8c-9e83-127660e21727', 'volume_name': 'volume-04fe8dc3-c901-4d8c-9e83-127660e21727', 'volume_size': 1, 'snapshot_id': 'd7be1516-b9ee-4a84-80a4-d993afa4df37'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0783d4-2ed3-4647-b487-a783d87b4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0783d4-2ed3-4647-b487-a783d87b4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a7f9c7-ca84-477d-86be-a40b67b40d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Volume 04fe8dc3-c901-4d8c-9e83-127660e21727: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04fe8dc3-c901-4d8c-9e83-127660e21727', 'volume_size': 1, 'snapshot_id': 'd7be1516-b9ee-4a84-80a4-d993afa4df37'} Sep 25 16:20:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-8904370c-05ec-4080-b301-e479743ca745 req-6f354e02-e00f-48c8-ae72-948ae0a49d1e tempest-TestInstancesWithCinderVolumes-256537226 None] attachment_update completed successfully. Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "cinder-quobyte-d7be1516-b9ee-4a84-80a4-d993afa4df37-04fe8dc3-c901-4d8c-9e83-127660e21727" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-d7be1516-b9ee-4a84-80a4-d993afa4df37-04fe8dc3-c901-4d8c-9e83-127660e21727" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Creating volume 04fe8dc3-c901-4d8c-9e83-127660e21727 from snapshot d7be1516-b9ee-4a84-80a4-d993afa4df37 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "cinder-quobyte-04fe8dc3-c901-4d8c-9e83-127660e21727" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-04fe8dc3-c901-4d8c-9e83-127660e21727" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] snapshot: d7be1516-b9ee-4a84-80a4-d993afa4df37, volume: 04fe8dc3-c901-4d8c-9e83-127660e21727, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8fcd78-5948-485b-a977-c3bfa342bb72]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:22 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 Sep 25 16:20:22 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:23 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37" returned: 0 in 0.552s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dabe6df-6a30-4513-99db-f3585279e537(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:20:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c75b448-1e66-4bee-a2bb-8d59c02c9078]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:23 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 Sep 25 16:20:23 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:24 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537" returned: 0 in 0.650s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:20:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:20:24 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:20:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:24 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 Sep 25 16:20:24 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6862e854-75a7-4e5d-bd11-bd6193968a3b req-db27131d-c4b2-44db-ba5c-b9f4530d64a7 tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-5439d25d-8f83-4b94-bf1e-262ceb3ad424 req-e87a0e39-f56b-43e0-9f9a-b6988cfe687e tempest-TestInstancesWithCinderVolumes-256537226 None] Terminate volume connection completed successfully. Sep 25 16:20:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-5439d25d-8f83-4b94-bf1e-262ceb3ad424 req-e87a0e39-f56b-43e0-9f9a-b6988cfe687e tempest-TestInstancesWithCinderVolumes-256537226 None] Deleting attachment bbe960bf-689a-45d7-a5e6-6a9d05ef490d. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:20:32 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727" returned: 0 in 8.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:20:32 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Converted 1024.00 MB image at 121.92 MB/s Sep 25 16:20:32 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 is being set with open permissions: ugo+rw Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:32 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 Sep 25 16:20:32 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "cinder-28d9258e-2dfb-4b5d-8265-5988fc81a895-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-28d9258e-2dfb-4b5d-8265-5988fc81a895-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "cinder-quobyte-28d9258e-2dfb-4b5d-8265-5988fc81a895" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-quobyte-28d9258e-2dfb-4b5d-8265-5988fc81a895" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4da984a-6640-40ed-a30d-c003bf154f4e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:32 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-04fe8dc3-c901-4d8c-9e83-127660e21727" released by "_copy_volume_from_snapshot" :: held 10.125s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:32 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 Sep 25 16:20:32 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-d7be1516-b9ee-4a84-80a4-d993afa4df37-04fe8dc3-c901-4d8c-9e83-127660e21727" released by "_create_volume_from_snapshot" :: held 10.410s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.430s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6862e854-75a7-4e5d-bd11-bd6193968a3b req-db27131d-c4b2-44db-ba5c-b9f4530d64a7 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.481s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6862e854-75a7-4e5d-bd11-bd6193968a3b req-db27131d-c4b2-44db-ba5c-b9f4530d64a7 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a7f9c7-ca84-477d-86be-a40b67b40d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fe8dc3-c901-4d8c-9e83-127660e21727', 'volume_size': 1, 'snapshot_id': 'd7be1516-b9ee-4a84-80a4-d993afa4df37'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1b905d-2fd7-42db-8e55-4e80793208b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:33 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895" returned: 0 in 0.553s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:33 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895 Sep 25 16:20:33 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Volume volume-04fe8dc3-c901-4d8c-9e83-127660e21727 (04fe8dc3-c901-4d8c-9e83-127660e21727): created successfully Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1b905d-2fd7-42db-8e55-4e80793208b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Flow 'volume_create_manager' (dde93d35-675b-448d-8ef5-103d0548c3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-6862e854-75a7-4e5d-bd11-bd6193968a3b req-db27131d-c4b2-44db-ba5c-b9f4530d64a7 tempest-AttachVolumeNegativeTest-162056123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dba7388f-376f-4a06-b5ea-2fe3fed6a99d', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:20:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4d5ad76e-20c5-4033-be51-5e0d0f3ca0a4 tempest-VolumeDependencyTests-1748424908 None] Created volume successfully. Sep 25 16:20:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-6862e854-75a7-4e5d-bd11-bd6193968a3b req-db27131d-c4b2-44db-ba5c-b9f4530d64a7 tempest-AttachVolumeNegativeTest-162056123 None] attachment_update completed successfully. Sep 25 16:20:33 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-28d9258e-2dfb-4b5d-8265-5988fc81a895" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-quobyte-28d9258e-2dfb-4b5d-8265-5988fc81a895" released by "delete_volume" :: held 1.008s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:33 devstack cinder-volume[87314]: WARNING cinder.quota [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-177044590-1334910551 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-177044590-1334910551, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:20:33 devstack cinder-volume[87314]: WARNING cinder.quota [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-177044590-1334910551 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-177044590-1334910551, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Created reservations ['4be10c76-9201-4614-be6d-ae9a90d1a20d', '734309fd-1e92-4390-a551-58f5b3bdac34', 'b6eeb7ee-c77e-48b1-8cf8-ff55c83cae40', 'b1dd893e-d562-4d3e-aea1-ff9c916d69ea'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:33 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:33 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "cinder-d7be1516-b9ee-4a84-80a4-d993afa4df37-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-d7be1516-b9ee-4a84-80a4-d993afa4df37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "cinder-quobyte-6dabe6df-6a30-4513-99db-f3585279e537" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-6dabe6df-6a30-4513-99db-f3585279e537" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "cinder-quobyte-d7be1516-b9ee-4a84-80a4-d993afa4df37" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-d7be1516-b9ee-4a84-80a4-d993afa4df37" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Deleting offline snapshot d7be1516-b9ee-4a84-80a4-d993afa4df37 of volume 6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] snapshot_file for this snap is: volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c701528-0d78-4f6d-8286-f10f3098ff26]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:34 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 Sep 25 16:20:34 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:34 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.672s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Deleted volume successfully. Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-df5b3f6c-906f-4f9d-8641-c28858c7f7c8 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-28d9258e-2dfb-4b5d-8265-5988fc81a895-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:34 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37" returned: 0 in 0.662s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dabe6df-6a30-4513-99db-f3585279e537(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[da29557d-6040-4335-91e3-9bafbe74383d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:35 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 Sep 25 16:20:35 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:35 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537" returned: 0 in 0.677s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:35 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 Sep 25 16:20:35 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:36 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37" returned: 0 in 0.504s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:36 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37 Sep 25 16:20:36 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:36 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537.d7be1516-b9ee-4a84-80a4-d993afa4df37" returned: 0 in 0.363s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-d7be1516-b9ee-4a84-80a4-d993afa4df37" released by "_delete_snapshot" :: held 2.411s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-6dabe6df-6a30-4513-99db-f3585279e537" released by "delete_snapshot" :: held 2.456s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Created reservations ['4849a6e4-dc19-4c0a-bdc1-6b3c78a0fce2', 'ba0962a3-65fe-466a-b7f9-21ae61d22b2f', '7b7bcfc8-7797-479a-b770-f0a4c76ad788', '771c71d3-e414-4a3a-89b8-89f59381fcdb'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Delete snapshot completed successfully. Sep 25 16:20:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e1f9836-c9cf-411b-8ce9-1dcc4cc9bb42 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-d7be1516-b9ee-4a84-80a4-d993afa4df37-delete_snapshot" released by "delete_snapshot" :: held 2.714s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-dd25fd55-2a6e-4c73-8c6d-bf2590466aca req-4f798ad9-0133-4cfa-be67-495b7ab96d7a tempest-AttachVolumeNegativeTest-162056123 None] Terminate volume connection completed successfully. Sep 25 16:20:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-dd25fd55-2a6e-4c73-8c6d-bf2590466aca req-4f798ad9-0133-4cfa-be67-495b7ab96d7a tempest-AttachVolumeNegativeTest-162056123 None] Deleting attachment dba7388f-376f-4a06-b5ea-2fe3fed6a99d. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:20:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "cinder-6dabe6df-6a30-4513-99db-f3585279e537-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-6dabe6df-6a30-4513-99db-f3585279e537-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "cinder-quobyte-6dabe6df-6a30-4513-99db-f3585279e537" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-6dabe6df-6a30-4513-99db-f3585279e537" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6970b5-7955-44c9-9dac-0bdd77388408]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:37 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 Sep 25 16:20:37 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-4980af35-9279-46b2-8760-abb0461a3291 req-5afefe22-c75d-4dbe-9237-7afb65cbb2a1 tempest-TestInstancesWithCinderVolumes-256537226 None] Terminate volume connection completed successfully. Sep 25 16:20:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-4980af35-9279-46b2-8760-abb0461a3291 req-5afefe22-c75d-4dbe-9237-7afb65cbb2a1 tempest-TestInstancesWithCinderVolumes-256537226 None] Deleting attachment ba3d70f3-85c7-458f-88f2-47d10a3a8626. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:20:38 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537" returned: 0 in 0.526s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:38 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537 Sep 25 16:20:38 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "cinder-72f8c0cf-f05a-4be4-bb46-76971c63089a-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-72f8c0cf-f05a-4be4-bb46-76971c63089a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "cinder-quobyte-72f8c0cf-f05a-4be4-bb46-76971c63089a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-quobyte-72f8c0cf-f05a-4be4-bb46-76971c63089a" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:38 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6dabe6df-6a30-4513-99db-f3585279e537" returned: 0 in 0.609s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54db35d-a22a-4f42-978d-07c172115f6e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-6dabe6df-6a30-4513-99db-f3585279e537" released by "delete_volume" :: held 1.241s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Created reservations ['5ffe6b4e-5bba-4203-b67c-18e6c02f6753', '0792a22f-3bc8-42c1-8650-190ca85361f6', '18ac2e75-11c7-40c9-b93f-dd6b0e9b92a2', 'b2c8efd8-386a-4761-a1a4-6db153bd8775'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:38 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a Sep 25 16:20:38 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:39 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:39 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:39 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a" returned: 0 in 0.535s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:39 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a Sep 25 16:20:39 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:39 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.487s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Deleted volume successfully. Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f27ea7e-1547-4781-ab8e-5755764559a7 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-6dabe6df-6a30-4513-99db-f3585279e537-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:39 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72f8c0cf-f05a-4be4-bb46-76971c63089a" returned: 0 in 0.392s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-quobyte-72f8c0cf-f05a-4be4-bb46-76971c63089a" released by "delete_volume" :: held 1.015s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:39 devstack cinder-volume[87314]: WARNING cinder.quota [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25449312-906007674 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25449312-906007674, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:20:39 devstack cinder-volume[87314]: WARNING cinder.quota [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25449312-906007674 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25449312-906007674, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Created reservations ['e1bf9e7e-1012-4178-bf48-e63816f7ab0c', '933eed48-5699-4235-b42b-81621486865e', 'c54e07cc-5ec3-4b1c-b14a-73bdfa761f96', '17b2fbbe-2d51-4bf0-986d-da6a13cef9d1'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "cinder-04fe8dc3-c901-4d8c-9e83-127660e21727-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-04fe8dc3-c901-4d8c-9e83-127660e21727-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "cinder-quobyte-04fe8dc3-c901-4d8c-9e83-127660e21727" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:40 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:40 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-04fe8dc3-c901-4d8c-9e83-127660e21727" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66fd1f0-1643-4e81-8726-d7a50258adb1]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:40 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 Sep 25 16:20:40 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:40 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.426s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Deleted volume successfully. Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b009b03f-8fc8-4042-99ae-fc5ccd54e96a tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-72f8c0cf-f05a-4be4-bb46-76971c63089a-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:40 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727" returned: 0 in 0.662s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:40 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727 Sep 25 16:20:40 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:41 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04fe8dc3-c901-4d8c-9e83-127660e21727" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-quobyte-04fe8dc3-c901-4d8c-9e83-127660e21727" released by "delete_volume" :: held 1.079s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Created reservations ['7e5bb662-8d85-4edd-af68-f71f1c45532a', '165e9c34-e510-40df-8dc8-9f917e0b9fb5', '53c08fa6-2090-4b28-aea3-bbc085896fe8', '466e73b7-60fd-4166-b2fb-cb6fcd1c5624'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:41 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:41 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:41 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.324s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Deleted volume successfully. Sep 25 16:20:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-225b9b36-36b4-4288-9ec9-c4d88629cc75 tempest-VolumeDependencyTests-1748424908 None] Lock "cinder-04fe8dc3-c901-4d8c-9e83-127660e21727-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "cinder-fe700dbe-fde1-4fa2-b539-16fd672f3ac0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-fe700dbe-fde1-4fa2-b539-16fd672f3ac0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "cinder-quobyte-fe700dbe-fde1-4fa2-b539-16fd672f3ac0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-quobyte-fe700dbe-fde1-4fa2-b539-16fd672f3ac0" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aad649-aefc-4b7c-bbb9-d372fcb7b740]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:43 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 Sep 25 16:20:43 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:43 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0" returned: 0 in 0.632s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:44 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0 Sep 25 16:20:44 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:44 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-fe700dbe-fde1-4fa2-b539-16fd672f3ac0" returned: 0 in 0.290s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-quobyte-fe700dbe-fde1-4fa2-b539-16fd672f3ac0" released by "delete_volume" :: held 1.062s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Created reservations ['7fd78d71-6bc0-402e-8aa8-1a5a16d0752e', 'b646731c-f2e3-415c-aeb2-e40f070b408c', '2251b6e8-fb9f-4414-a9e0-265853fe15cc', '5799f151-d5a5-46bb-85d6-b915f69cf764'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:44 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:44 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:44 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.340s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:45 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Deleted volume successfully. Sep 25 16:20:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458d6911-7d86-4a64-85b2-25c6f8247eca tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-fe700dbe-fde1-4fa2-b539-16fd672f3ac0-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-115c2968-55ae-49e3-9997-2443a5f5ab85 req-1b4b2131-eda3-4df9-b935-aa1f45fb9411 tempest-TestInstancesWithCinderVolumes-256537226 None] Terminate volume connection completed successfully. Sep 25 16:20:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-115c2968-55ae-49e3-9997-2443a5f5ab85 req-1b4b2131-eda3-4df9-b935-aa1f45fb9411 tempest-TestInstancesWithCinderVolumes-256537226 None] Deleting attachment ef124fd6-a53c-4989-9a61-8ee9780a204e. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:20:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "cinder-8937eaff-5961-4f23-a8a5-85c09cbd050f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-8937eaff-5961-4f23-a8a5-85c09cbd050f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "cinder-quobyte-8937eaff-5961-4f23-a8a5-85c09cbd050f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-quobyte-8937eaff-5961-4f23-a8a5-85c09cbd050f" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[708bb326-814c-4abb-be56-e00c6e907eee]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:46 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f Sep 25 16:20:46 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:46 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f" returned: 0 in 0.544s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:46 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f Sep 25 16:20:46 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:46 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8937eaff-5961-4f23-a8a5-85c09cbd050f" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-quobyte-8937eaff-5961-4f23-a8a5-85c09cbd050f" released by "delete_volume" :: held 0.926s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Created reservations ['c6302bd0-fa31-45cd-89db-30a6b96cac9d', '81b163dc-b6fa-48b3-a07f-58a05d34447d', '13d579e6-28eb-4f4f-ac17-20d1d9434960', '927d7b77-d86b-4976-b8fa-df371c979840'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:47 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:47 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:47 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.306s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Deleted volume successfully. Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "cinder-ef676f57-82ff-48b4-a0b5-05e975a3f943-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-ef676f57-82ff-48b4-a0b5-05e975a3f943-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-437df60f-f59a-4b29-a209-5dce2ce90c2c tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-8937eaff-5961-4f23-a8a5-85c09cbd050f-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "cinder-quobyte-ef676f57-82ff-48b4-a0b5-05e975a3f943" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-quobyte-ef676f57-82ff-48b4-a0b5-05e975a3f943" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7931bc0d-5be0-4323-8afb-49b7fbfd37a0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:47 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 Sep 25 16:20:47 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:47 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943" returned: 0 in 0.461s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:47 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943 Sep 25 16:20:47 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "cinder-e45ea672-684b-4238-ac34-4b0f27099e48-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-e45ea672-684b-4238-ac34-4b0f27099e48-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:48 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ef676f57-82ff-48b4-a0b5-05e975a3f943" returned: 0 in 0.413s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-quobyte-ef676f57-82ff-48b4-a0b5-05e975a3f943" released by "delete_volume" :: held 0.944s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "cinder-quobyte-e45ea672-684b-4238-ac34-4b0f27099e48" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-quobyte-e45ea672-684b-4238-ac34-4b0f27099e48" acquired by "delete_volume" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:48 devstack cinder-volume[87314]: WARNING cinder.quota [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2110347170-2023669277 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2110347170-2023669277, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:20:48 devstack cinder-volume[87314]: WARNING cinder.quota [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2110347170-2023669277 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2110347170-2023669277, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfefb13a-0c41-4ba1-b5b3-d4ad6bb12b97]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Created reservations ['65fa06d0-960e-4355-b8b3-ab3946857a24', '9a22938c-b46e-4568-bdfb-452b2db5ebac', '2e195fe3-2b28-4472-bfdf-ebb08dcd0b4f', '50f08c3a-83af-492c-808d-2dcec8c8b763'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:48 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48 Sep 25 16:20:48 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:48 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:48 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:49 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48" returned: 0 in 0.509s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:49 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48 Sep 25 16:20:49 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:49 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Deleted volume successfully. Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3c1cfcfe-268d-4d94-b368-0b32c2f5e7f3 tempest-TestInstancesWithCinderVolumes-256537226 None] Lock "cinder-ef676f57-82ff-48b4-a0b5-05e975a3f943-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:49 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e45ea672-684b-4238-ac34-4b0f27099e48" returned: 0 in 0.328s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-quobyte-e45ea672-684b-4238-ac34-4b0f27099e48" released by "delete_volume" :: held 0.908s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Created reservations ['61ce1289-0f5f-49c3-930b-4f47cba3e418', 'eb1c3a7c-afe7-4085-a396-bd49c6154458', 'f8709b97-6b13-425e-ba0c-5c984ee9c463', '5ceb8ecd-8a8d-4792-a883-cad8f9ccefbd'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:49 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:49 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:49 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.316s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Deleted volume successfully. Sep 25 16:20:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-49213fef-015d-4a94-af71-dbd055f6f1b7 tempest-AttachVolumeNegativeTest-162056123 None] Lock "cinder-e45ea672-684b-4238-ac34-4b0f27099e48-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:50 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Flow 'volume_create_manager' (da6b391b-f376-4f8c-ba51-4d35bcdbf967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6bbce5-39df-4b68-aa73-f2ff36f8b97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6bbce5-39df-4b68-aa73-f2ff36f8b97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b9263c-fe85-4976-a6de-d265354bcda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13452d353614eee9d1a90007e0bbcf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:51Z,use_quota=True,user_id='53086978150a4347a5f5cfb6c96678ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745f429c-2702-467f-bdd4-4459779e5034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745f429c-2702-467f-bdd4-4459779e5034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd608ab-9deb-428a-a787-c53deec66031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:50 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:20:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd608ab-9deb-428a-a787-c53deec66031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3b9263c-fe85-4976-a6de-d265354bcda0', 'volume_name': 'volume-d3b9263c-fe85-4976-a6de-d265354bcda0', 'volume_size': 1, 'image_id': 'fdfabab8-26db-42e4-b211-0ca6556e1194', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdfabab8-26db-42e4-b211-0ca6556e1194', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0191df40b3200a6951026d78e6dac5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c13452d353614eee9d1a90007e0bbcf6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c6b78919e57f9a91aa54ca1e21142b70ded9d5bcc71ae49301cd57f06e5478ba5ea3182727830d94de93b034049c3cc09e63791c062b0419957ebb6430784f5', 'id': 'fdfabab8-26db-42e4-b211-0ca6556e1194', 'created_at': datetime.datetime(2026, 9, 25, 14, 20, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 20, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdfabab8-26db-42e4-b211-0ca6556e1194/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398896e7-61c2-4d5b-9921-0b716d1c02b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398896e7-61c2-4d5b-9921-0b716d1c02b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce7b354-0089-4564-87d9-f6b5b62b3fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:51 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Volume d3b9263c-fe85-4976-a6de-d265354bcda0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3b9263c-fe85-4976-a6de-d265354bcda0', 'volume_size': 1, 'image_id': 'fdfabab8-26db-42e4-b211-0ca6556e1194', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdfabab8-26db-42e4-b211-0ca6556e1194', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0191df40b3200a6951026d78e6dac5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c13452d353614eee9d1a90007e0bbcf6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c6b78919e57f9a91aa54ca1e21142b70ded9d5bcc71ae49301cd57f06e5478ba5ea3182727830d94de93b034049c3cc09e63791c062b0419957ebb6430784f5', 'id': 'fdfabab8-26db-42e4-b211-0ca6556e1194', 'created_at': datetime.datetime(2026, 9, 25, 14, 20, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 20, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdfabab8-26db-42e4-b211-0ca6556e1194/file', 'properties': {}}, 'image_service': } Sep 25 16:20:51 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Trying to clone d3b9263c-fe85-4976-a6de-d265354bcda0 from image fdfabab8-26db-42e4-b211-0ca6556e1194 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fdfabab8-26db-42e4-b211-0ca6556e1194', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:20:51 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:20:51 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:20:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b013b2d7-04e5-4de6-bb51-d5f267417b34]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:51 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD Sep 25 16:20:51 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:52 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:52 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD Sep 25 16:20:52 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:52 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:20:52 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Temporary image fdfabab8-26db-42e4-b211-0ca6556e1194 is fetched for user 53086978150a4347a5f5cfb6c96678ce. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:20:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc33c65b-e5d3-4d8e-82b7-4a898def5c19]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:52 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD Sep 25 16:20:52 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:53 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:53 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD Sep 25 16:20:53 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:53 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD" returned: 1 in 0.460s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b9263c-fe85-4976-a6de-d265354bcda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13452d353614eee9d1a90007e0bbcf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:51Z,use_quota=True,user_id='53086978150a4347a5f5cfb6c96678ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Creating volume d3b9263c-fe85-4976-a6de-d265354bcda0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:53 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:20:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:53 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 1073741824 Sep 25 16:20:53 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:54 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 1073741824" returned: 0 in 0.567s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:54 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 Sep 25 16:20:54 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:54 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Attempting download of fdfabab8-26db-42e4-b211-0ca6556e1194 ((None, [{'url': 'file:///opt/stack/data/glance/images/fdfabab8-26db-42e4-b211-0ca6556e1194', 'metadata': {}}])) to volume d3b9263c-fe85-4976-a6de-d265354bcda0. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a3664a-3904-4a26-9ee6-3169cc28a649]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdfabab8-26db-42e4-b211-0ca6556e1194_klmrzse_ {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:54 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdfabab8-26db-42e4-b211-0ca6556e1194_klmrzse_ Sep 25 16:20:54 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:54 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdfabab8-26db-42e4-b211-0ca6556e1194_klmrzse_" returned: 0 in 0.429s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdfabab8-26db-42e4-b211-0ca6556e1194_klmrzse_ {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:55 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdfabab8-26db-42e4-b211-0ca6556e1194_klmrzse_ Sep 25 16:20:55 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:55 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdfabab8-26db-42e4-b211-0ca6556e1194_klmrzse_" returned: 1 in 0.410s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdfabab8-26db-42e4-b211-0ca6556e1194_klmrzse_' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:20:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae731dc-3d12-4781-9702-412070662993]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:55 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD Sep 25 16:20:55 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:55 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:55 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD Sep 25 16:20:55 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:56 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD" returned: 1 in 0.457s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:20:56 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] fdfabab8-26db-42e4-b211-0ca6556e1194 was raw, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1150}} Sep 25 16:20:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:56 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 Sep 25 16:20:56 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:56 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0" returned: 0 in 0.648s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:56 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fdfabab8-26db-42e4-b211-0ca6556e1194_4kwh7yi0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:20:56 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:20:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:56 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 1G Sep 25 16:20:56 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:57 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 1G" returned: 0 in 0.553s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Downloaded image fdfabab8-26db-42e4-b211-0ca6556e1194 ((None, [{'url': 'file:///opt/stack/data/glance/images/fdfabab8-26db-42e4-b211-0ca6556e1194', 'metadata': {}}])) to volume d3b9263c-fe85-4976-a6de-d265354bcda0 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Temporary image fdfabab8-26db-42e4-b211-0ca6556e1194 for user 53086978150a4347a5f5cfb6c96678ce is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Marking volume d3b9263c-fe85-4976-a6de-d265354bcda0 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Copying metadata from image fdfabab8-26db-42e4-b211-0ca6556e1194 to d3b9263c-fe85-4976-a6de-d265354bcda0. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Creating volume glance metadata for volume d3b9263c-fe85-4976-a6de-d265354bcda0 backed by image fdfabab8-26db-42e4-b211-0ca6556e1194 with: {'image_id': 'fdfabab8-26db-42e4-b211-0ca6556e1194', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f0191df40b3200a6951026d78e6dac5d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce7b354-0089-4564-87d9-f6b5b62b3fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b9263c-fe85-4976-a6de-d265354bcda0', 'volume_size': 1, 'image_id': 'fdfabab8-26db-42e4-b211-0ca6556e1194', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdfabab8-26db-42e4-b211-0ca6556e1194', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0191df40b3200a6951026d78e6dac5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c13452d353614eee9d1a90007e0bbcf6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c6b78919e57f9a91aa54ca1e21142b70ded9d5bcc71ae49301cd57f06e5478ba5ea3182727830d94de93b034049c3cc09e63791c062b0419957ebb6430784f5', 'id': 'fdfabab8-26db-42e4-b211-0ca6556e1194', 'created_at': datetime.datetime(2026, 9, 25, 14, 20, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 20, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdfabab8-26db-42e4-b211-0ca6556e1194/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e606359c-89bf-429e-8b7f-fde71fec18e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:57 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Volume volume-d3b9263c-fe85-4976-a6de-d265354bcda0 (d3b9263c-fe85-4976-a6de-d265354bcda0): created successfully Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e606359c-89bf-429e-8b7f-fde71fec18e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Flow 'volume_create_manager' (da6b391b-f376-4f8c-ba51-4d35bcdbf967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-55ef7b47-d84d-4e92-ac24-b80762a4cabe tempest-VolumeImageDependencyTests-515722228 None] Created volume successfully. Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Acquiring lock "cinder-d3b9263c-fe85-4976-a6de-d265354bcda0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Lock "cinder-d3b9263c-fe85-4976-a6de-d265354bcda0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Acquiring lock "cinder-quobyte-d3b9263c-fe85-4976-a6de-d265354bcda0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Lock "cinder-quobyte-d3b9263c-fe85-4976-a6de-d265354bcda0" acquired by "delete_volume" :: waited 0.055s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:58 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:58 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[69349cf1-5def-4923-8fc3-bba578cf4c6f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:58 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 Sep 25 16:20:58 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:59 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.367s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:20:59 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0" returned: 0 in 0.473s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:59 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0 Sep 25 16:20:59 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:59 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d3b9263c-fe85-4976-a6de-d265354bcda0" returned: 0 in 0.340s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Lock "cinder-quobyte-d3b9263c-fe85-4976-a6de-d265354bcda0" released by "delete_volume" :: held 0.911s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Created reservations ['52b2c6d2-aa14-42d8-a3ee-708488505da6', 'b9a976d0-ea61-4b12-be3f-5e96f9e5949f', '9f16795c-fb43-4e6c-9f80-5c773831c00d', '73926adc-296b-4f41-b927-a6f6773bf5b2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:59 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:20:59 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:00 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:00 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Deleted volume successfully. Sep 25 16:21:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5eec461e-7e69-4cc3-8bfd-f615d2aa5abd tempest-VolumeImageDependencyTests-515722228 None] Lock "cinder-d3b9263c-fe85-4976-a6de-d265354bcda0-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Flow 'volume_create_manager' (8565589f-1649-49d3-9210-299cf125a784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6276fae9-f9cd-4d5f-83ad-a64c0390575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6276fae9-f9cd-4d5f-83ad-a64c0390575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-230167154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34e84e2-e668-4a6d-a618-e2d8bf4cba9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d569a17e50f346d9bc7b96dfe9d9bb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:01Z,use_quota=True,user_id='aa77cd0f3c504085880d7e67e00884a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbac350c-ba9d-4697-8795-79e2a09b4cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbac350c-ba9d-4697-8795-79e2a09b4cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392eb983-7c63-47ff-bf65-9922b896faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392eb983-7c63-47ff-bf65-9922b896faff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34e84e2-e668-4a6d-a618-e2d8bf4cba9c', 'volume_name': 'volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8420cbad-b356-429b-ad4f-5097640cca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8420cbad-b356-429b-ad4f-5097640cca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304c26a8-3f64-4694-8052-71534eb45acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Volume f34e84e2-e668-4a6d-a618-e2d8bf4cba9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c', 'volume_size': 1} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-230167154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34e84e2-e668-4a6d-a618-e2d8bf4cba9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d569a17e50f346d9bc7b96dfe9d9bb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:01Z,use_quota=True,user_id='aa77cd0f3c504085880d7e67e00884a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Creating volume f34e84e2-e668-4a6d-a618-e2d8bf4cba9c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:01 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:21:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:01 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c 1073741824 Sep 25 16:21:01 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:02 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c 1073741824" returned: 0 in 0.702s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:02 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c Sep 25 16:21:02 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:02 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304c26a8-3f64-4694-8052-71534eb45acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308c18e0-3b55-4855-b2fd-db4e9881d379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Volume volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c (f34e84e2-e668-4a6d-a618-e2d8bf4cba9c): created successfully Sep 25 16:21:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308c18e0-3b55-4855-b2fd-db4e9881d379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Flow 'volume_create_manager' (8565589f-1649-49d3-9210-299cf125a784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-99702213-b4dc-4173-89bf-836a98c7cac8 req-6bcc3f80-ccb8-41a3-9d67-7884586060bb tempest-VolumesGetTestJSON-1819123954 None] Created volume successfully. Sep 25 16:21:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Acquiring lock "cinder-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Lock "cinder-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Acquiring lock "cinder-quobyte-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Lock "cinder-quobyte-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abe659b-1918-4f97-a94e-7a86b612d92b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:04 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c Sep 25 16:21:04 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:04 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c" returned: 0 in 0.466s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:04 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c Sep 25 16:21:04 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:05 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c" returned: 0 in 0.311s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Lock "cinder-quobyte-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c" released by "delete_volume" :: held 0.830s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG cinder.quota [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Created reservations ['56afa6e0-2ef7-47ad-84e2-7ad0643cebff', '73016127-c883-4077-a931-39836c8c1599', 'f3a662c3-8ffb-48e9-952c-e3159414b20d', '15e47407-7482-4e7f-ba51-f96f38170bcf'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:05 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:21:05 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:05 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG cinder.manager [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Deleted volume successfully. Sep 25 16:21:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5c719417-5f55-448f-af69-427a02aa2820 req-f9e51d32-6139-4dd9-9e86-a43e59eb8e35 tempest-VolumesGetTestJSON-1819123954 None] Lock "cinder-f34e84e2-e668-4a6d-a618-e2d8bf4cba9c-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=122,cinder:SELECT=121,cinder:INSERT=33,cinder:DELETE=12 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=114,cinder:INSERT=39,cinder:UPDATE=144,cinder:DELETE=7 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Flow 'volume_create_manager' (18ea7f90-033c-4c28-ac3c-5d068722d4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9567be6-8616-458b-ac91-3837d041248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9567be6-8616-458b-ac91-3837d041248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1511046649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2092fb05-7e51-47bf-a8f2-7d178d192d62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d9c904703854061b14ec0a378ef8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:11Z,use_quota=True,user_id='259e3327623a4bfd8c8b88ba529ace5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ee401f-bdfd-49d8-aef3-961a73109e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ee401f-bdfd-49d8-aef3-961a73109e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5546384-7101-4690-ae10-c03760eb3fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5546384-7101-4690-ae10-c03760eb3fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2092fb05-7e51-47bf-a8f2-7d178d192d62', 'volume_name': 'volume-2092fb05-7e51-47bf-a8f2-7d178d192d62', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806d9cd8-180d-4e7a-9e63-88f0447d2f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806d9cd8-180d-4e7a-9e63-88f0447d2f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fb278d-c1dd-405d-adbe-990073d67941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Volume 2092fb05-7e51-47bf-a8f2-7d178d192d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2092fb05-7e51-47bf-a8f2-7d178d192d62', 'volume_size': 1} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1511046649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2092fb05-7e51-47bf-a8f2-7d178d192d62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d9c904703854061b14ec0a378ef8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:11Z,use_quota=True,user_id='259e3327623a4bfd8c8b88ba529ace5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Creating volume 2092fb05-7e51-47bf-a8f2-7d178d192d62 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:11 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 1073741824 Sep 25 16:21:11 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:11 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 1073741824" returned: 0 in 0.499s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:11 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 Sep 25 16:21:11 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:12 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fb278d-c1dd-405d-adbe-990073d67941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2092fb05-7e51-47bf-a8f2-7d178d192d62', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8e2867-dbff-4b0d-bff7-67c9714711e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Volume volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 (2092fb05-7e51-47bf-a8f2-7d178d192d62): created successfully Sep 25 16:21:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8e2867-dbff-4b0d-bff7-67c9714711e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Flow 'volume_create_manager' (18ea7f90-033c-4c28-ac3c-5d068722d4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ebe663d8-070c-4615-8e94-9f279d3f520f tempest-VolumesTestJSON-1648077232 None] Created volume successfully. Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Flow 'volume_create_manager' (e2105dee-0b5f-4de5-8087-8355bbf24a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ce0f42-5ef9-49e4-8b0f-c9a12121f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ce0f42-5ef9-49e4-8b0f-c9a12121f368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1795377730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b75b4b-7828-43bc-a8dd-97aa95cccad7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d9c904703854061b14ec0a378ef8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:14Z,use_quota=True,user_id='259e3327623a4bfd8c8b88ba529ace5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7323f4-bfd8-453a-9b89-9f232dfc7e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7323f4-bfd8-453a-9b89-9f232dfc7e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a65f84-2b64-4a30-a8fc-7f0840e508e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a65f84-2b64-4a30-a8fc-7f0840e508e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b75b4b-7828-43bc-a8dd-97aa95cccad7', 'volume_name': 'volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d7c58b-8a69-454e-9714-2c680b65bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d7c58b-8a69-454e-9714-2c680b65bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f048e6-c5e0-4c31-b5a6-f0f68a17007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Volume 48b75b4b-7828-43bc-a8dd-97aa95cccad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7', 'volume_size': 1} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1795377730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b75b4b-7828-43bc-a8dd-97aa95cccad7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d9c904703854061b14ec0a378ef8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:14Z,use_quota=True,user_id='259e3327623a4bfd8c8b88ba529ace5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Creating volume 48b75b4b-7828-43bc-a8dd-97aa95cccad7 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:14 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:14 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 1073741824 Sep 25 16:21:14 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:14 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 1073741824" returned: 0 in 0.553s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:14 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 Sep 25 16:21:14 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:15 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7" returned: 0 in 0.303s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f048e6-c5e0-4c31-b5a6-f0f68a17007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8293a25-6640-41ea-bd47-5dcf98ae92c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Volume volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 (48b75b4b-7828-43bc-a8dd-97aa95cccad7): created successfully Sep 25 16:21:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8293a25-6640-41ea-bd47-5dcf98ae92c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Flow 'volume_create_manager' (e2105dee-0b5f-4de5-8087-8355bbf24a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e368da66-153a-4ec2-b014-5a349cc17161 tempest-VolumesTestJSON-1648077232 None] Created volume successfully. Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Flow 'volume_create_manager' (2f54126f-945d-4cda-9583-561065b6c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25d5b78-433f-4849-9ccb-19010d41822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25d5b78-433f-4849-9ccb-19010d41822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2119456175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f95b6d-25a3-4615-93ac-c5d72b31909d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d9c904703854061b14ec0a378ef8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:17Z,use_quota=True,user_id='259e3327623a4bfd8c8b88ba529ace5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5547752e-0d52-4742-afa3-4a9d3674e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5547752e-0d52-4742-afa3-4a9d3674e974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510e1571-3f7b-4e0a-ab39-520b9edca3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510e1571-3f7b-4e0a-ab39-520b9edca3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f95b6d-25a3-4615-93ac-c5d72b31909d', 'volume_name': 'volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75dd897-2ea7-488d-970b-cad14c109f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75dd897-2ea7-488d-970b-cad14c109f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d1105d-d694-4ec4-bb35-8f420eb57490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:17 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Volume c1f95b6d-25a3-4615-93ac-c5d72b31909d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d', 'volume_size': 1} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2119456175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f95b6d-25a3-4615-93ac-c5d72b31909d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d9c904703854061b14ec0a378ef8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:17Z,use_quota=True,user_id='259e3327623a4bfd8c8b88ba529ace5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Creating volume c1f95b6d-25a3-4615-93ac-c5d72b31909d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:17 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:17 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d 1073741824 Sep 25 16:21:17 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:17 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d 1073741824" returned: 0 in 0.576s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:17 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d Sep 25 16:21:17 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:18 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d" returned: 0 in 0.403s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d1105d-d694-4ec4-bb35-8f420eb57490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7257c170-c529-41e9-b98a-c926b8c9c9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:18 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Volume volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d (c1f95b6d-25a3-4615-93ac-c5d72b31909d): created successfully Sep 25 16:21:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7257c170-c529-41e9-b98a-c926b8c9c9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Flow 'volume_create_manager' (2f54126f-945d-4cda-9583-561065b6c344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3c185399-8794-4d1a-a2ba-56a0e9f4c8ac tempest-VolumesTestJSON-1648077232 None] Created volume successfully. Sep 25 16:21:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "cinder-c1f95b6d-25a3-4615-93ac-c5d72b31909d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-c1f95b6d-25a3-4615-93ac-c5d72b31909d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "cinder-quobyte-c1f95b6d-25a3-4615-93ac-c5d72b31909d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-quobyte-c1f95b6d-25a3-4615-93ac-c5d72b31909d" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:20 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91d5a85-3958-45bf-b5d1-1b1b2f49ccc8]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:20 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d Sep 25 16:21:20 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:21 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d" returned: 0 in 0.565s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:21 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d Sep 25 16:21:21 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:21 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c1f95b6d-25a3-4615-93ac-c5d72b31909d" returned: 0 in 0.274s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-quobyte-c1f95b6d-25a3-4615-93ac-c5d72b31909d" released by "delete_volume" :: held 0.901s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Created reservations ['fe13e9cd-2119-4619-8d72-6624422ec966', '42e82c44-580b-4e16-821a-25505a3f360b', '6c8373c1-f4e3-450d-8494-3753279434cd', 'a820f5cb-fb12-4de4-91a5-5c87535560a9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:21 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:21:21 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "cinder-48b75b4b-7828-43bc-a8dd-97aa95cccad7-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-48b75b4b-7828-43bc-a8dd-97aa95cccad7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "cinder-quobyte-48b75b4b-7828-43bc-a8dd-97aa95cccad7" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-quobyte-48b75b4b-7828-43bc-a8dd-97aa95cccad7" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91686ca-dafb-4d94-a230-93eaf43df65e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:22 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 Sep 25 16:21:22 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:22 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.376s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Deleted volume successfully. Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-37f3a1b7-7458-4a59-93e3-de8fb6d664f7 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-c1f95b6d-25a3-4615-93ac-c5d72b31909d-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:22 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7" returned: 0 in 0.440s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:22 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7 Sep 25 16:21:22 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:22 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-48b75b4b-7828-43bc-a8dd-97aa95cccad7" returned: 0 in 0.283s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-quobyte-48b75b4b-7828-43bc-a8dd-97aa95cccad7" released by "delete_volume" :: held 0.777s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Created reservations ['8c0b9640-1e8c-4984-a63e-046a9d6742cc', 'c4c9116f-6252-4707-acdf-3ad0ed38e1e9', '21a4c227-5f1b-48f9-a56b-bbbc9ebda8ec', 'e2e64c65-a266-4b08-8bc2-6ca66102f83f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:22 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:21:22 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "cinder-2092fb05-7e51-47bf-a8f2-7d178d192d62-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-2092fb05-7e51-47bf-a8f2-7d178d192d62-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "cinder-quobyte-2092fb05-7e51-47bf-a8f2-7d178d192d62" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:23 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.324s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-quobyte-2092fb05-7e51-47bf-a8f2-7d178d192d62" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Deleted volume successfully. Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f9f4d-c00f-46fd-85ba-a9e4c2b1e3f1]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a7d67dce-919a-4723-9caa-f298afaec2d4 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-48b75b4b-7828-43bc-a8dd-97aa95cccad7-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:23 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 Sep 25 16:21:23 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:23 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62" returned: 0 in 0.505s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:23 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62 Sep 25 16:21:23 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:23 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2092fb05-7e51-47bf-a8f2-7d178d192d62" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-quobyte-2092fb05-7e51-47bf-a8f2-7d178d192d62" released by "delete_volume" :: held 0.845s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Created reservations ['a161d0bf-6746-49d6-a83b-3e1105b5e5f8', '5ccdbd8f-1bf2-4fb0-a091-ba6fd5946d2b', '5f4afd67-4f15-4ff6-ab07-26e866069444', 'ed9bef91-436b-47c0-9011-c9750716f6ee'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:24 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:21:24 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:24 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.303s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Deleted volume successfully. Sep 25 16:21:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-597d6883-b46a-453f-887b-a20e256e5b58 tempest-VolumesTestJSON-1648077232 None] Lock "cinder-2092fb05-7e51-47bf-a8f2-7d178d192d62-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c1a73c37-3713-4710-8060-1a6d289aab5c tempest-GroupsV314Test-275413077 None] Group tempest-GroupsV314Test-Group-431696555: creating Sep 25 16:21:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c1a73c37-3713-4710-8060-1a6d289aab5c tempest-GroupsV314Test-275413077 None] Group tempest-GroupsV314Test-Group-431696555: created successfully Sep 25 16:21:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c1a73c37-3713-4710-8060-1a6d289aab5c tempest-GroupsV314Test-275413077 None] Create group completed successfully. Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Flow 'volume_create_manager' (0fbd27ff-461d-4627-9202-b717c5d4a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7613c885-1976-4392-98a1-12d1e778fcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7613c885-1976-4392-98a1-12d1e778fcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-745082754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dac6c37a-e3e0-4fc8-b681-79310bf5b16f,host='devstack@QuobyteHD#QuobyteHD',id=1ab34e28-76f3-46ee-a6aa-c9174bace908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e21c4558524e2db9a283a49cebe5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:31Z,use_quota=True,user_id='e2f3e59cdf014021ad1608da8e186ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a1167b1-3679-4af0-98b2-3c48c828512b),volume_type_id=3a1167b1-3679-4af0-98b2-3c48c828512b)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa41398d-ab3f-49fb-90a2-65664935816c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa41398d-ab3f-49fb-90a2-65664935816c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defbd88a-7f37-4299-be90-ad48dad8ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defbd88a-7f37-4299-be90-ad48dad8ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab34e28-76f3-46ee-a6aa-c9174bace908', 'volume_name': 'volume-1ab34e28-76f3-46ee-a6aa-c9174bace908', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa1c24d-e724-478e-9802-9443e3d98d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa1c24d-e724-478e-9802-9443e3d98d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232942b3-7998-43a6-9c1e-db6314cac095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Volume 1ab34e28-76f3-46ee-a6aa-c9174bace908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab34e28-76f3-46ee-a6aa-c9174bace908', 'volume_size': 1} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dac6c37a-e3e0-4fc8-b681-79310bf5b16f,created_at=2026-09-25T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-745082754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dac6c37a-e3e0-4fc8-b681-79310bf5b16f,host='devstack@QuobyteHD#QuobyteHD',id=1ab34e28-76f3-46ee-a6aa-c9174bace908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e21c4558524e2db9a283a49cebe5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:31Z,use_quota=True,user_id='e2f3e59cdf014021ad1608da8e186ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a1167b1-3679-4af0-98b2-3c48c828512b),volume_type_id=3a1167b1-3679-4af0-98b2-3c48c828512b)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Creating volume 1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:31 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:21:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:31 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 1073741824 Sep 25 16:21:31 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:32 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 1073741824" returned: 0 in 0.621s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:32 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 Sep 25 16:21:32 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:32 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908" returned: 0 in 0.320s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232942b3-7998-43a6-9c1e-db6314cac095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab34e28-76f3-46ee-a6aa-c9174bace908', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4587c8c-a307-4792-8e0d-69212dd06887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Volume volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 (1ab34e28-76f3-46ee-a6aa-c9174bace908): created successfully Sep 25 16:21:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4587c8c-a307-4792-8e0d-69212dd06887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Flow 'volume_create_manager' (0fbd27ff-461d-4627-9202-b717c5d4a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e2168d5b-c015-432c-a386-79ed01e79004 tempest-GroupsV314Test-275413077 None] Created volume successfully. Sep 25 16:21:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:34 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Cloning volume 1ab34e28-76f3-46ee-a6aa-c9174bace908 to volume 16903074-7746-41e8-bf85-78944c435d6a Sep 25 16:21:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Creating offline snapshot 271b68e6-06ab-4242-b199-f30be1086917 of volume 1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:21:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daedecc-b87d-4b4d-bba8-d98fc646a539]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:34 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 Sep 25 16:21:34 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:34 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908" returned: 0 in 0.427s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:35 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 1G Sep 25 16:21:35 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:35 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 1G" returned: 0 in 0.450s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:35 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 Sep 25 16:21:35 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:35 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917" returned: 0 in 0.353s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:35 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:35 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 Sep 25 16:21:35 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Flow 'volume_create_manager' (e0d9b100-ec52-4499-8f66-fa31e3d95c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8de528-6ae0-4ff0-82ae-2f35fa776968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8de528-6ae0-4ff0-82ae-2f35fa776968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-956988829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6b83ab-c094-420f-ba72-ad7b711e94c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96bbb6a3b976413da8265cd41417cdc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:36Z,use_quota=True,user_id='b9ec08f2c1bb43e184ab9b1c3d94e06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb8a66c-2b11-49fe-8fd2-3959c81a5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb8a66c-2b11-49fe-8fd2-3959c81a5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c2c62a-3af4-4be3-bc87-a4b240a25525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c2c62a-3af4-4be3-bc87-a4b240a25525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6b83ab-c094-420f-ba72-ad7b711e94c8', 'volume_name': 'volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69921513-17bc-4885-8a3e-09a1169a0056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69921513-17bc-4885-8a3e-09a1169a0056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01273c29-109d-45fa-980f-ad3e86aa440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Volume 4f6b83ab-c094-420f-ba72-ad7b711e94c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8', 'volume_size': 1} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:36 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:36 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.info Sep 25 16:21:36 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:36 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.info" returned: 0 in 0.294s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:36 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:36 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.info Sep 25 16:21:36 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:36 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.info" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Acquiring lock "cinder-quobyte-16903074-7746-41e8-bf85-78944c435d6a" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Lock "cinder-quobyte-16903074-7746-41e8-bf85-78944c435d6a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] snapshot: 271b68e6-06ab-4242-b199-f30be1086917, volume: 16903074-7746-41e8-bf85-78944c435d6a, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2354990d-8608-480e-a806-d636dde080d8]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:36 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 Sep 25 16:21:36 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:37 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ab34e28-76f3-46ee-a6aa-c9174bace908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:21:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9db34ff-0b30-45dc-9763-7b1c69b57858]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:37 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 Sep 25 16:21:37 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:37 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908" returned: 0 in 0.436s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:21:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:21:37 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:21:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:37 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a Sep 25 16:21:37 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:45 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a" returned: 0 in 8.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:45 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908, size 1024.00 MB, duration 8.34 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:21:45 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Converted 1024.00 MB image at 122.84 MB/s Sep 25 16:21:45 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:21:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:46 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a Sep 25 16:21:46 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=31,cinder:INSERT=8,cinder:UPDATE=36,cinder:DELETE=4 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=30,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:21:46 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Lock "cinder-quobyte-16903074-7746-41e8-bf85-78944c435d6a" released by "_copy_volume_from_snapshot" :: held 9.563s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Acquiring lock "cinder-quobyte-271b68e6-06ab-4242-b199-f30be1086917" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Lock "cinder-quobyte-271b68e6-06ab-4242-b199-f30be1086917" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Deleting offline snapshot 271b68e6-06ab-4242-b199-f30be1086917 of volume 1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] snapshot_file for this snap is: volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[86286baa-5b39-48b3-9906-3f8724123379]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:46 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 Sep 25 16:21:46 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:46 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917" returned: 0 in 0.411s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ab34e28-76f3-46ee-a6aa-c9174bace908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[18417b1f-98d8-49b6-be7a-c4f65b19e831]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:46 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 Sep 25 16:21:46 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:47 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908" returned: 0 in 0.723s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:47 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 Sep 25 16:21:47 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:47 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:47 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917 Sep 25 16:21:47 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:48 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908.271b68e6-06ab-4242-b199-f30be1086917" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Lock "cinder-quobyte-271b68e6-06ab-4242-b199-f30be1086917" released by "_delete_snapshot" :: held 1.952s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.794s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.244s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-956988829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6b83ab-c094-420f-ba72-ad7b711e94c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96bbb6a3b976413da8265cd41417cdc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:36Z,use_quota=True,user_id='b9ec08f2c1bb43e184ab9b1c3d94e06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Creating volume 4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:48 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:48 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 1073741824 Sep 25 16:21:48 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e6cf2df8-afc5-4759-90d8-ac2041852b54 tempest-GroupsV314Test-275413077 None] Create group from source-group-dac6c37a-e3e0-4fc8-b681-79310bf5b16f completed successfully. Sep 25 16:21:48 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 1073741824" returned: 0 in 0.587s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:48 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 Sep 25 16:21:48 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:49 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01273c29-109d-45fa-980f-ad3e86aa440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065200e5-797b-4047-971a-b7e58a971d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:49 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Volume volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 (4f6b83ab-c094-420f-ba72-ad7b711e94c8): created successfully Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065200e5-797b-4047-971a-b7e58a971d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Flow 'volume_create_manager' (e0d9b100-ec52-4499-8f66-fa31e3d95c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ff75fae7-508a-4068-ad51-3abb8380b88e tempest-TestStampPattern-1625162679 None] Created volume successfully. Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Acquiring lock "cinder-quobyte-16903074-7746-41e8-bf85-78944c435d6a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Lock "cinder-quobyte-16903074-7746-41e8-bf85-78944c435d6a" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc472cf9-5a9e-4a61-9561-071eef0912a6]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:49 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a Sep 25 16:21:49 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:50 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a" returned: 0 in 0.480s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:50 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a Sep 25 16:21:50 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:50 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-16903074-7746-41e8-bf85-78944c435d6a" returned: 0 in 0.291s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Lock "cinder-quobyte-16903074-7746-41e8-bf85-78944c435d6a" released by "delete_volume" :: held 0.838s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Created reservations ['d80873c1-773f-4a86-b5fd-0cd66f4b6f78'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:50 devstack cinder-volume[87314]: WARNING cinder.quota [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-610705323 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-610705323, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:21:50 devstack cinder-volume[87314]: WARNING cinder.quota [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-610705323 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-610705323, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Created reservations ['3f6e7e3a-b7b4-46ea-a749-3a6c91db1535', '8197bebb-79e5-4c3f-8a83-86b79a75d8e8', 'a9af32da-ef7d-461d-b7a3-7e69eeb64a5f', 'dd0f4651-4df9-482a-ad60-138cff43caa2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:50 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:21:50 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:51 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-456d846e-b539-4137-a940-aa6f0629447b tempest-GroupsV314Test-275413077 None] Delete group completed successfully. Sep 25 16:21:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Acquiring lock "cinder-quobyte-1ab34e28-76f3-46ee-a6aa-c9174bace908" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Lock "cinder-quobyte-1ab34e28-76f3-46ee-a6aa-c9174bace908" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb2ea2-4f76-4958-90e5-931a389e293c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:51 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 Sep 25 16:21:51 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:51 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908" returned: 0 in 0.495s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:51 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908 Sep 25 16:21:51 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:52 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1ab34e28-76f3-46ee-a6aa-c9174bace908" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Lock "cinder-quobyte-1ab34e28-76f3-46ee-a6aa-c9174bace908" released by "delete_volume" :: held 0.886s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Created reservations ['40e33452-0e1d-4345-89b6-7e460e6be569'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Created reservations ['245504c5-8b1b-4198-bf9a-159463084c06', '8d7a4d90-4bae-48a8-b62e-7bfbb2d15b57', '784cd291-f14c-4629-b6b4-1e8354f04d62', 'caee36e6-c657-4f31-a499-b322d2acab80'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:52 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:21:52 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:52 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:52 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7b96203a-6f52-4445-86f3-293ac83bfa80 tempest-GroupsV314Test-275413077 None] Delete group completed successfully. Sep 25 16:21:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:21:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:58 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:21:58 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:59 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.361s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:21:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:21:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:22:02 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=24,cinder:SELECT=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:22:02 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=30,cinder:SELECT=16,cinder:INSERT=4 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Flow 'volume_create_manager' (c5aa9377-4f1a-4aab-bb40-5588a9617153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3721d4a1-23e9-4d90-8169-c283a097b9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3721d4a1-23e9-4d90-8169-c283a097b9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-811585354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6836c8c5-9f69-4a33-bd3b-c9aec596ed78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db90cb7b16fe42b5b00e0cbe0061dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:08Z,use_quota=True,user_id='fea7035375844822b832d68831abc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4723c4e6-1647-4ce0-9c4b-4d3bb3318be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4723c4e6-1647-4ce0-9c4b-4d3bb3318be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a666651-bcb6-407f-8a3e-ba7fd4e96a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a666651-bcb6-407f-8a3e-ba7fd4e96a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6836c8c5-9f69-4a33-bd3b-c9aec596ed78', 'volume_name': 'volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1545f531-4f3e-4f10-999b-51adc7b39418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1545f531-4f3e-4f10-999b-51adc7b39418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1775738-ce72-4e7f-8dad-354d69e89bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Volume 6836c8c5-9f69-4a33-bd3b-c9aec596ed78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78', 'volume_size': 1} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-811585354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6836c8c5-9f69-4a33-bd3b-c9aec596ed78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db90cb7b16fe42b5b00e0cbe0061dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:08Z,use_quota=True,user_id='fea7035375844822b832d68831abc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Creating volume 6836c8c5-9f69-4a33-bd3b-c9aec596ed78 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:08 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 1073741824 Sep 25 16:22:08 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:08 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 1073741824" returned: 0 in 0.538s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:08 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 Sep 25 16:22:08 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:09 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1775738-ce72-4e7f-8dad-354d69e89bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644bb601-bd74-4de0-8f1a-602a6597cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Volume volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 (6836c8c5-9f69-4a33-bd3b-c9aec596ed78): created successfully Sep 25 16:22:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644bb601-bd74-4de0-8f1a-602a6597cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Flow 'volume_create_manager' (c5aa9377-4f1a-4aab-bb40-5588a9617153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d256057f-32f4-41fa-a09a-795926edd35d tempest-VolumeQuotasAdminTestJSON-379072597 None] Created volume successfully. Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Acquiring lock "cinder-6836c8c5-9f69-4a33-bd3b-c9aec596ed78-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "cinder-6836c8c5-9f69-4a33-bd3b-c9aec596ed78-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Acquiring lock "cinder-quobyte-6836c8c5-9f69-4a33-bd3b-c9aec596ed78" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "cinder-quobyte-6836c8c5-9f69-4a33-bd3b-c9aec596ed78" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee221fb1-5d69-42a2-bd6b-15e36d551c02]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:10 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 Sep 25 16:22:10 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:10 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78" returned: 0 in 0.435s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:10 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78 Sep 25 16:22:10 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:10 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6836c8c5-9f69-4a33-bd3b-c9aec596ed78" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "cinder-quobyte-6836c8c5-9f69-4a33-bd3b-c9aec596ed78" released by "delete_volume" :: held 0.753s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:10 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Created reservations ['17fe958e-499e-4157-af68-5fceb6c3b04b', 'f306b250-a23e-4c09-897f-22c4f814be06', '374d4900-a78a-4277-8cd9-f247272e0dab', '42fc9eb0-89f6-418c-87bf-ca19943c236b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:11 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:22:11 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:11 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.295s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Deleted volume successfully. Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9fe14618-6876-4dd8-a885-e251bb07aa7b tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "cinder-6836c8c5-9f69-4a33-bd3b-c9aec596ed78-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Flow 'volume_create_manager' (684363bc-bf67-4601-afe2-2b5dbc17f9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db514f4-4ebc-4313-8427-5fd0c351ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db514f4-4ebc-4313-8427-5fd0c351ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-274078316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04189937-2956-4dd7-9d88-fba040335a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db90cb7b16fe42b5b00e0cbe0061dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:12Z,use_quota=True,user_id='fea7035375844822b832d68831abc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd0d09d-a75f-4b25-92b1-605309a48ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd0d09d-a75f-4b25-92b1-605309a48ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7cf837-49be-424b-9fae-f36454b3b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7cf837-49be-424b-9fae-f36454b3b947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04189937-2956-4dd7-9d88-fba040335a4b', 'volume_name': 'volume-04189937-2956-4dd7-9d88-fba040335a4b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba434e60-2a0d-48f9-a543-0bbbcbe94010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba434e60-2a0d-48f9-a543-0bbbcbe94010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea8de73-3f60-45a1-90aa-ab82818fb851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Volume 04189937-2956-4dd7-9d88-fba040335a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04189937-2956-4dd7-9d88-fba040335a4b', 'volume_size': 1} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-274078316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04189937-2956-4dd7-9d88-fba040335a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db90cb7b16fe42b5b00e0cbe0061dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:12Z,use_quota=True,user_id='fea7035375844822b832d68831abc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Creating volume 04189937-2956-4dd7-9d88-fba040335a4b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:22:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:11 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b 1073741824 Sep 25 16:22:11 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:12 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b 1073741824" returned: 0 in 0.654s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:12 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b Sep 25 16:22:12 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-eee5ee90-dff5-4cd3-bd87-90bbe13508af req-8252725e-904a-4e73-a597-b0f57fc77067 tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:12 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-eee5ee90-dff5-4cd3-bd87-90bbe13508af req-8252725e-904a-4e73-a597-b0f57fc77067 tempest-TestStampPattern-1625162679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.108s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea8de73-3f60-45a1-90aa-ab82818fb851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04189937-2956-4dd7-9d88-fba040335a4b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df590f52-4878-456d-a089-b23e09f2432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-eee5ee90-dff5-4cd3-bd87-90bbe13508af req-8252725e-904a-4e73-a597-b0f57fc77067 tempest-TestStampPattern-1625162679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Volume volume-04189937-2956-4dd7-9d88-fba040335a4b (04189937-2956-4dd7-9d88-fba040335a4b): created successfully Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df590f52-4878-456d-a089-b23e09f2432e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Flow 'volume_create_manager' (684363bc-bf67-4601-afe2-2b5dbc17f9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-81ee87b8-5e7e-421a-b2fa-1e6cd6e59478 tempest-VolumeQuotasAdminTestJSON-379072597 None] Created volume successfully. Sep 25 16:22:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-eee5ee90-dff5-4cd3-bd87-90bbe13508af req-8252725e-904a-4e73-a597-b0f57fc77067 tempest-TestStampPattern-1625162679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1342e1e3-0450-44a7-833f-91a4db35e72f', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:22:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-eee5ee90-dff5-4cd3-bd87-90bbe13508af req-8252725e-904a-4e73-a597-b0f57fc77067 tempest-TestStampPattern-1625162679 None] attachment_update completed successfully. Sep 25 16:22:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-21f43d43-8588-4942-aa72-63756ffbbe3f tempest-VolumeQuotasAdminTestJSON-950506183 None] Transfer volume completed successfully. Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Acquiring lock "cinder-04189937-2956-4dd7-9d88-fba040335a4b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Lock "cinder-04189937-2956-4dd7-9d88-fba040335a4b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Acquiring lock "cinder-quobyte-04189937-2956-4dd7-9d88-fba040335a4b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Lock "cinder-quobyte-04189937-2956-4dd7-9d88-fba040335a4b" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ebcf64-2bd2-47ce-97dc-3c13e4c52568]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:15 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b Sep 25 16:22:15 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:15 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b" returned: 0 in 0.454s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:15 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b Sep 25 16:22:15 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:15 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-04189937-2956-4dd7-9d88-fba040335a4b" returned: 0 in 0.275s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Lock "cinder-quobyte-04189937-2956-4dd7-9d88-fba040335a4b" released by "delete_volume" :: held 0.776s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Created reservations ['cc6f6bb0-8aa4-4a65-bd9d-f1e426da7084', '411d19f0-ca0b-4372-8cbb-694b3f705c75', '7467c882-c900-4e0f-8e73-810746321418', 'a5caadb0-37ea-4bb0-8ce3-2a2fbf975549'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:16 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:22:16 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:16 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Deleted volume successfully. Sep 25 16:22:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d05f35ac-7d73-44bf-b177-e287e9122e5b tempest-VolumeQuotasAdminTestJSON-19220123 None] Lock "cinder-04189937-2956-4dd7-9d88-fba040335a4b-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-3b6c066b-efe5-46e6-bde1-12806eb21273 req-978cf3de-3871-4d1e-af9e-c0ee1c4bc541 tempest-TestStampPattern-1625162679 None] Terminate volume connection completed successfully. Sep 25 16:22:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-3b6c066b-efe5-46e6-bde1-12806eb21273 req-978cf3de-3871-4d1e-af9e-c0ee1c4bc541 tempest-TestStampPattern-1625162679 None] Deleting attachment 1342e1e3-0450-44a7-833f-91a4db35e72f. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:22:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Creating offline snapshot 9bb47fb5-a255-4b8b-964e-ff42dfc11dac of volume 4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:22:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d879b6d-fa19-45e7-9da2-5cb53ba4e804]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:19 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 Sep 25 16:22:19 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:19 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8" returned: 0 in 0.441s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:19 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac 1G Sep 25 16:22:19 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:20 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac 1G" returned: 0 in 0.530s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:20 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac Sep 25 16:22:20 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:20 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac" returned: 0 in 0.354s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:20 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac is being set with open permissions: ugo+rw Sep 25 16:22:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:20 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac Sep 25 16:22:20 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:21 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac" returned: 0 in 0.295s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:21 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.info Sep 25 16:22:21 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:21 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.info" returned: 0 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:21 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.info is being set with open permissions: ugo+rw Sep 25 16:22:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:21 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.info Sep 25 16:22:21 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:21 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.info" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cdbf1b2b-8f6a-41cc-8318-97f0e6ffeb56 tempest-TestStampPattern-1625162679 None] Create snapshot completed successfully Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Flow 'volume_create_manager' (fae2c738-a3a7-4b21-af09-450032327e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7925e60d-90e2-4ea0-88ae-1b87951ed8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7925e60d-90e2-4ea0-88ae-1b87951ed8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1104756546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f108f97-54bb-4468-b881-05fe8c0ede9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f00f8ecbc04aecb224798ceaada0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:25Z,use_quota=True,user_id='eb6bf7eb0b5e498f8d6099540ae4be03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b7b2d7-1e8b-47f6-9105-4a769169c51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b7b2d7-1e8b-47f6-9105-4a769169c51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a09025-7b40-42d3-88f8-830f1661d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a09025-7b40-42d3-88f8-830f1661d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f108f97-54bb-4468-b881-05fe8c0ede9d', 'volume_name': 'volume-1f108f97-54bb-4468-b881-05fe8c0ede9d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66ab43e-e60d-4a47-9587-69ebb73bd26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66ab43e-e60d-4a47-9587-69ebb73bd26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794fa55c-817f-49d4-a6dc-2642a1ee28ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Volume 1f108f97-54bb-4468-b881-05fe8c0ede9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f108f97-54bb-4468-b881-05fe8c0ede9d', 'volume_size': 1} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1104756546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f108f97-54bb-4468-b881-05fe8c0ede9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f00f8ecbc04aecb224798ceaada0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:25Z,use_quota=True,user_id='eb6bf7eb0b5e498f8d6099540ae4be03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Creating volume 1f108f97-54bb-4468-b881-05fe8c0ede9d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:25 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:22:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:25 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d 1073741824 Sep 25 16:22:25 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:26 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d 1073741824" returned: 0 in 0.539s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:26 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d Sep 25 16:22:26 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:26 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794fa55c-817f-49d4-a6dc-2642a1ee28ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f108f97-54bb-4468-b881-05fe8c0ede9d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34840386-c1f0-4092-8e90-fc679f2a282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Volume volume-1f108f97-54bb-4468-b881-05fe8c0ede9d (1f108f97-54bb-4468-b881-05fe8c0ede9d): created successfully Sep 25 16:22:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34840386-c1f0-4092-8e90-fc679f2a282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Flow 'volume_create_manager' (fae2c738-a3a7-4b21-af09-450032327e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4aec1284-ef07-420a-b6f8-9c93899c46ae tempest-VolumesServicesTestJSON-2061557885 None] Created volume successfully. Sep 25 16:22:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Acquiring lock "cinder-1f108f97-54bb-4468-b881-05fe8c0ede9d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Lock "cinder-1f108f97-54bb-4468-b881-05fe8c0ede9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Acquiring lock "cinder-quobyte-1f108f97-54bb-4468-b881-05fe8c0ede9d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Lock "cinder-quobyte-1f108f97-54bb-4468-b881-05fe8c0ede9d" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6966cb-8b48-4ba3-9289-f78f949986f0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:28 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d Sep 25 16:22:28 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:28 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d" returned: 0 in 0.474s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:28 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d Sep 25 16:22:28 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:28 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1f108f97-54bb-4468-b881-05fe8c0ede9d" returned: 0 in 0.327s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Lock "cinder-quobyte-1f108f97-54bb-4468-b881-05fe8c0ede9d" released by "delete_volume" :: held 0.874s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Created reservations ['349e4cc7-a610-4a6e-9245-2240fc4175c1', 'a2124910-8b1d-4b68-9958-77407624d92e', '76686c7f-0214-4a65-b449-29874a1bea84', '5f00bee5-dc1d-4117-837d-ec6975a0387b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:28 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:22:28 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:29 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.384s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:29 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Deleted volume successfully. Sep 25 16:22:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-827acbc4-7efa-4413-8133-74782fcfa417 tempest-VolumesServicesTestJSON-2061557885 None] Lock "cinder-1f108f97-54bb-4468-b881-05fe8c0ede9d-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Flow 'volume_create_manager' (a6586242-60ca-4e0b-86dd-9c11745a0d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b43fd5-91d3-4a6b-84f0-933588396cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b43fd5-91d3-4a6b-84f0-933588396cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1554182847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94e34b4-5c71-421c-8c94-29040e2b0e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96bbb6a3b976413da8265cd41417cdc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9bb47fb5-a255-4b8b-964e-ff42dfc11dac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:31Z,use_quota=True,user_id='b9ec08f2c1bb43e184ab9b1c3d94e06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f48b204-2cd8-431a-ba27-a7c9d2216fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f48b204-2cd8-431a-ba27-a7c9d2216fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867dbf45-7b47-4879-915c-433be16f59f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867dbf45-7b47-4879-915c-433be16f59f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e94e34b4-5c71-421c-8c94-29040e2b0e7c', 'volume_name': 'volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c', 'volume_size': 1, 'snapshot_id': '9bb47fb5-a255-4b8b-964e-ff42dfc11dac'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad763593-8995-436d-bdc8-80a21e18b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad763593-8995-436d-bdc8-80a21e18b132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48686c9-8228-4427-8542-a54dba4a6bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Volume e94e34b4-5c71-421c-8c94-29040e2b0e7c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c', 'volume_size': 1, 'snapshot_id': '9bb47fb5-a255-4b8b-964e-ff42dfc11dac'} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Acquiring lock "cinder-quobyte-9bb47fb5-a255-4b8b-964e-ff42dfc11dac-e94e34b4-5c71-421c-8c94-29040e2b0e7c" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-9bb47fb5-a255-4b8b-964e-ff42dfc11dac-e94e34b4-5c71-421c-8c94-29040e2b0e7c" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Creating volume e94e34b4-5c71-421c-8c94-29040e2b0e7c from snapshot 9bb47fb5-a255-4b8b-964e-ff42dfc11dac {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Acquiring lock "cinder-quobyte-e94e34b4-5c71-421c-8c94-29040e2b0e7c" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-e94e34b4-5c71-421c-8c94-29040e2b0e7c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] snapshot: 9bb47fb5-a255-4b8b-964e-ff42dfc11dac, volume: e94e34b4-5c71-421c-8c94-29040e2b0e7c, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[36be0435-a5fe-4b92-9617-df4cb65def7e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:31 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac Sep 25 16:22:31 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:31 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac" returned: 0 in 0.695s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b7ba3-31c0-4282-b148-e662ae22ce0f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:31 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 Sep 25 16:22:31 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:32 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8" returned: 0 in 0.618s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:22:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:22:32 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:22:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:32 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c Sep 25 16:22:32 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:40 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=37,cinder:SELECT=31,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:22:41 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=38,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:22:42 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c" returned: 0 in 9.995s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:42 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8, size 1024.00 MB, duration 10.00 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:22:42 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Converted 1024.00 MB image at 102.44 MB/s Sep 25 16:22:42 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c is being set with open permissions: ugo+rw Sep 25 16:22:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:42 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c Sep 25 16:22:42 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:42 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c" returned: 0 in 0.440s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-e94e34b4-5c71-421c-8c94-29040e2b0e7c" released by "_copy_volume_from_snapshot" :: held 11.918s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-9bb47fb5-a255-4b8b-964e-ff42dfc11dac-e94e34b4-5c71-421c-8c94-29040e2b0e7c" released by "_create_volume_from_snapshot" :: held 12.014s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.041s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48686c9-8228-4427-8542-a54dba4a6bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c', 'volume_size': 1, 'snapshot_id': '9bb47fb5-a255-4b8b-964e-ff42dfc11dac'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e31de5-0784-4317-97d2-9eb4dfdb2441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:43 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Volume volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c (e94e34b4-5c71-421c-8c94-29040e2b0e7c): created successfully Sep 25 16:22:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e31de5-0784-4317-97d2-9eb4dfdb2441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Flow 'volume_create_manager' (a6586242-60ca-4e0b-86dd-9c11745a0d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-52c5862d-93f3-44d6-8d01-5fc1d3cbe8b9 tempest-TestStampPattern-1625162679 None] Created volume successfully. Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Flow 'volume_create_manager' (1688f95f-7b9d-48fd-ac3d-51a558971541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a66fb0-04c7-4818-b455-67796d233035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a66fb0-04c7-4818-b455-67796d233035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-218013993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b5072a-7b88-465b-8fc5-c66ed6223a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea6b7903b9d45acae843154b3532de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:49Z,use_quota=True,user_id='56821730caa34f7185dfb6d6cbb6dd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda7aa71-8659-4a62-9010-535aaf51ec6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda7aa71-8659-4a62-9010-535aaf51ec6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20dfa7e-b584-4df1-a554-81e53b6d1222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20dfa7e-b584-4df1-a554-81e53b6d1222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b5072a-7b88-465b-8fc5-c66ed6223a9c', 'volume_name': 'volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccc0525-988b-4912-83ea-8f7a7a0a809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccc0525-988b-4912-83ea-8f7a7a0a809a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b0093c-a059-4afc-a79a-b23ed57a7182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Volume f4b5072a-7b88-465b-8fc5-c66ed6223a9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c', 'volume_size': 1} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-218013993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b5072a-7b88-465b-8fc5-c66ed6223a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea6b7903b9d45acae843154b3532de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:49Z,use_quota=True,user_id='56821730caa34f7185dfb6d6cbb6dd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Creating volume f4b5072a-7b88-465b-8fc5-c66ed6223a9c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:48 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:22:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:48 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c 1073741824 Sep 25 16:22:48 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:49 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c 1073741824" returned: 0 in 0.486s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:49 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c Sep 25 16:22:49 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:49 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c" returned: 0 in 0.258s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b0093c-a059-4afc-a79a-b23ed57a7182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7984e97c-f787-4391-8ac3-d4ffdbf24740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:49 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Volume volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c (f4b5072a-7b88-465b-8fc5-c66ed6223a9c): created successfully Sep 25 16:22:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7984e97c-f787-4391-8ac3-d4ffdbf24740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Flow 'volume_create_manager' (1688f95f-7b9d-48fd-ac3d-51a558971541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4f06eaf9-5fc4-4972-a941-3a6aa42fbe18 tempest-VolumesMetadataTest-409019721 None] Created volume successfully. Sep 25 16:22:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Acquiring lock "cinder-f4b5072a-7b88-465b-8fc5-c66ed6223a9c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Lock "cinder-f4b5072a-7b88-465b-8fc5-c66ed6223a9c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Acquiring lock "cinder-quobyte-f4b5072a-7b88-465b-8fc5-c66ed6223a9c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Lock "cinder-quobyte-f4b5072a-7b88-465b-8fc5-c66ed6223a9c" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e33fe96-6612-4044-9cf0-5aec696fa763]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:52 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c Sep 25 16:22:52 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:52 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c" returned: 0 in 0.421s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:52 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c Sep 25 16:22:52 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:52 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f4b5072a-7b88-465b-8fc5-c66ed6223a9c" returned: 0 in 0.319s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Lock "cinder-quobyte-f4b5072a-7b88-465b-8fc5-c66ed6223a9c" released by "delete_volume" :: held 0.793s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Created reservations ['980b9f37-756d-4984-8cde-87d99080b812', '5daa3089-d477-4829-a100-0d66c3a4f0b1', '5d717720-2505-4432-a292-a95d847c5769', 'b0908b6e-abfe-4b6f-804a-b3ba094811c1'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:52 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:22:52 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:53 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:53 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Deleted volume successfully. Sep 25 16:22:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-93cfda5e-ac75-4a12-a5e8-e820b84d1c19 tempest-VolumesMetadataTest-409019721 None] Lock "cinder-f4b5072a-7b88-465b-8fc5-c66ed6223a9c-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:58 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:22:58 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Flow 'volume_create_manager' (4857e9fc-26ad-4e0c-a1b8-bca5115482c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:58 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec8b8df-b4de-443c-8b8a-95804c905e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec8b8df-b4de-443c-8b8a-95804c905e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-291739572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075fd21b-21a3-47de-82bb-b8924f895593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd56587717849d0b66db9c04cc5eeb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:59Z,use_quota=True,user_id='21f14300385c43b2b3daf3226fb64805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8b77aa-6171-471a-aa98-71c12105c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8b77aa-6171-471a-aa98-71c12105c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aceae5a-3400-44b1-aff4-a94798cafa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aceae5a-3400-44b1-aff4-a94798cafa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075fd21b-21a3-47de-82bb-b8924f895593', 'volume_name': 'volume-075fd21b-21a3-47de-82bb-b8924f895593', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2abe36-6822-44f1-81e2-2325d2597c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2abe36-6822-44f1-81e2-2325d2597c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17cc460-0fe3-4eed-bb68-4fc491757fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Volume 075fd21b-21a3-47de-82bb-b8924f895593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075fd21b-21a3-47de-82bb-b8924f895593', 'volume_size': 1} Sep 25 16:22:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-291739572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075fd21b-21a3-47de-82bb-b8924f895593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd56587717849d0b66db9c04cc5eeb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:59Z,use_quota=True,user_id='21f14300385c43b2b3daf3226fb64805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Creating volume 075fd21b-21a3-47de-82bb-b8924f895593 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:59 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:59 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593 1073741824 Sep 25 16:22:59 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:59 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593 1073741824" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:59 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593 Sep 25 16:22:59 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:59 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593" returned: 0 in 0.247s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17cc460-0fe3-4eed-bb68-4fc491757fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075fd21b-21a3-47de-82bb-b8924f895593', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafee369-7606-45d7-a156-1ec1b7ad8521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Volume volume-075fd21b-21a3-47de-82bb-b8924f895593 (075fd21b-21a3-47de-82bb-b8924f895593): created successfully Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafee369-7606-45d7-a156-1ec1b7ad8521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Flow 'volume_create_manager' (4857e9fc-26ad-4e0c-a1b8-bca5115482c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d901aea3-52cf-4609-955b-73bb9629dcaa tempest-VolumesTransfersV355Test-1756588956 None] Created volume successfully. Sep 25 16:23:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5448d0aa-1524-433b-bea9-2626d4d18438 tempest-VolumesTransfersV355Test-852450845 None] Transfer volume completed successfully. Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Acquiring lock "cinder-075fd21b-21a3-47de-82bb-b8924f895593-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Lock "cinder-075fd21b-21a3-47de-82bb-b8924f895593-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Acquiring lock "cinder-quobyte-075fd21b-21a3-47de-82bb-b8924f895593" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Lock "cinder-quobyte-075fd21b-21a3-47de-82bb-b8924f895593" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc72077-ca5e-407e-83d3-95dafb3f5e97]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:01 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593 Sep 25 16:23:01 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:01 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593" returned: 0 in 0.393s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:01 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593 Sep 25 16:23:01 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:01 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-075fd21b-21a3-47de-82bb-b8924f895593" returned: 0 in 0.331s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Lock "cinder-quobyte-075fd21b-21a3-47de-82bb-b8924f895593" released by "delete_volume" :: held 0.774s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Created reservations ['5567d76c-6c9a-475c-b714-8254046fcbec', 'dea33292-1314-4059-a13c-f6f9b3dbb1eb', '10d536ea-904c-451c-af29-e14a356e0787', '13627707-33b0-4e8c-b9de-ad666aa2a9f9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:02 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:23:02 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:02 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Deleted volume successfully. Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c4bb8b93-df4d-4ef3-b6b1-e0a3aafa3262 tempest-VolumesTransfersV355Test-763138804 None] Lock "cinder-075fd21b-21a3-47de-82bb-b8924f895593-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Flow 'volume_create_manager' (8e7dc68b-216c-4c72-8b96-90ae4a96e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1104401-36f3-4821-99a9-cde9463e9d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1104401-36f3-4821-99a9-cde9463e9d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1462605332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1542abc3-7673-41d9-947a-6347f0b407ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd56587717849d0b66db9c04cc5eeb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:03Z,use_quota=True,user_id='21f14300385c43b2b3daf3226fb64805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7d9306-4a2d-4b7d-a7e5-4c65bce2a837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7d9306-4a2d-4b7d-a7e5-4c65bce2a837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d92f474-c377-4dcb-b04e-de020212e666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d92f474-c377-4dcb-b04e-de020212e666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1542abc3-7673-41d9-947a-6347f0b407ee', 'volume_name': 'volume-1542abc3-7673-41d9-947a-6347f0b407ee', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80655ea-af8c-4c05-9d03-4b1f3f42709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80655ea-af8c-4c05-9d03-4b1f3f42709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5cfa03-ce95-4a14-9fd8-5c691ec33762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Volume 1542abc3-7673-41d9-947a-6347f0b407ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1542abc3-7673-41d9-947a-6347f0b407ee', 'volume_size': 1} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1462605332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1542abc3-7673-41d9-947a-6347f0b407ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd56587717849d0b66db9c04cc5eeb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:03Z,use_quota=True,user_id='21f14300385c43b2b3daf3226fb64805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Creating volume 1542abc3-7673-41d9-947a-6347f0b407ee {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:03 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:03 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee 1073741824 Sep 25 16:23:03 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:03 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee 1073741824" returned: 0 in 0.497s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:03 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee Sep 25 16:23:03 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:03 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5cfa03-ce95-4a14-9fd8-5c691ec33762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1542abc3-7673-41d9-947a-6347f0b407ee', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d496c6-c297-46fb-99f1-3344250da972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Volume volume-1542abc3-7673-41d9-947a-6347f0b407ee (1542abc3-7673-41d9-947a-6347f0b407ee): created successfully Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d496c6-c297-46fb-99f1-3344250da972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Flow 'volume_create_manager' (8e7dc68b-216c-4c72-8b96-90ae4a96e93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7a7a26a0-1970-405d-949f-9067bbc7e221 tempest-VolumesTransfersV355Test-1756588956 None] Created volume successfully. Sep 25 16:23:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Acquiring lock "cinder-1542abc3-7673-41d9-947a-6347f0b407ee-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Lock "cinder-1542abc3-7673-41d9-947a-6347f0b407ee-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Acquiring lock "cinder-quobyte-1542abc3-7673-41d9-947a-6347f0b407ee" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Lock "cinder-quobyte-1542abc3-7673-41d9-947a-6347f0b407ee" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[478c8016-f25c-4161-80c9-8a9852be8cec]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:05 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee Sep 25 16:23:05 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:05 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee" returned: 0 in 0.374s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:05 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee Sep 25 16:23:05 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:06 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1542abc3-7673-41d9-947a-6347f0b407ee" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Lock "cinder-quobyte-1542abc3-7673-41d9-947a-6347f0b407ee" released by "delete_volume" :: held 0.679s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Created reservations ['683f8eb5-f67b-4042-93ff-c31017c98b88', '42139c5c-cf55-476a-a10d-bcab1dd5a945', '008b41de-1813-42e5-9b95-e91c12f28f41', '37c283de-b94a-431d-bfbf-da18b0461aac'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:06 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:23:06 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:06 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Deleted volume successfully. Sep 25 16:23:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2805bc10-2442-448d-9099-b55a6f19ecd9 tempest-VolumesTransfersV355Test-763138804 None] Lock "cinder-1542abc3-7673-41d9-947a-6347f0b407ee-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Flow 'volume_create_manager' (8ed2a6e6-92fe-4d68-84e6-d3aee0497276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4bf51b-78b2-470b-9618-220cf58697b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4bf51b-78b2-470b-9618-220cf58697b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-671091784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159668a9-a3a2-493e-972e-1f4c3f03f491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f885f489d3f45f3b9db04ac26b83604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:14Z,use_quota=True,user_id='ee263d28d4124402835d31fd2cfa206e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2d45f4-0580-4630-8465-4a56e273e220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2d45f4-0580-4630-8465-4a56e273e220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe74d1c-3022-4971-8b0b-bafabe28eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe74d1c-3022-4971-8b0b-bafabe28eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159668a9-a3a2-493e-972e-1f4c3f03f491', 'volume_name': 'volume-159668a9-a3a2-493e-972e-1f4c3f03f491', 'volume_size': 2}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771f25f3-3a27-4df6-9d3e-5cb02aa36137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771f25f3-3a27-4df6-9d3e-5cb02aa36137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1cb16f-941a-4655-b61a-602b2abb5015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Volume 159668a9-a3a2-493e-972e-1f4c3f03f491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159668a9-a3a2-493e-972e-1f4c3f03f491', 'volume_size': 2} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-671091784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159668a9-a3a2-493e-972e-1f4c3f03f491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f885f489d3f45f3b9db04ac26b83604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:14Z,use_quota=True,user_id='ee263d28d4124402835d31fd2cfa206e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Creating volume 159668a9-a3a2-493e-972e-1f4c3f03f491 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:14 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491 2147483648 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:14 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491 2147483648 Sep 25 16:23:14 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:14 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491 2147483648" returned: 0 in 0.531s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:14 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491 Sep 25 16:23:14 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:15 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491" returned: 0 in 0.307s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1cb16f-941a-4655-b61a-602b2abb5015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159668a9-a3a2-493e-972e-1f4c3f03f491', 'volume_size': 2}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a795ccf9-d01e-42b3-9bc2-5eb8cf57f80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Volume volume-159668a9-a3a2-493e-972e-1f4c3f03f491 (159668a9-a3a2-493e-972e-1f4c3f03f491): created successfully Sep 25 16:23:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a795ccf9-d01e-42b3-9bc2-5eb8cf57f80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Flow 'volume_create_manager' (8ed2a6e6-92fe-4d68-84e6-d3aee0497276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-76293252-7f9b-4979-a7e3-059b2d8922c0 tempest-VolumesCloneNegativeTest-822469125 None] Created volume successfully. Sep 25 16:23:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Acquiring lock "cinder-159668a9-a3a2-493e-972e-1f4c3f03f491-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Lock "cinder-159668a9-a3a2-493e-972e-1f4c3f03f491-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Acquiring lock "cinder-quobyte-159668a9-a3a2-493e-972e-1f4c3f03f491" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Lock "cinder-quobyte-159668a9-a3a2-493e-972e-1f4c3f03f491" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd016547-5b96-46a6-a418-c08e3648cb3e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:16 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491 Sep 25 16:23:16 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:16 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491" returned: 0 in 0.426s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:16 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491 Sep 25 16:23:16 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:17 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-159668a9-a3a2-493e-972e-1f4c3f03f491" returned: 0 in 0.308s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Lock "cinder-quobyte-159668a9-a3a2-493e-972e-1f4c3f03f491" released by "delete_volume" :: held 0.790s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Created reservations ['977bcee9-0953-4786-9ed9-2d42cf54e16c', 'ea46f50a-98b6-4233-8134-f6f4da79a365', '60f49b5f-78b7-4c0d-8f18-09c4b53c4890', '5bb64d77-332b-49b8-817c-991d9f1a5356'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:17 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:23:17 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:17 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.274s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Deleted volume successfully. Sep 25 16:23:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a429f01a-d189-469e-8856-28631886bdac tempest-VolumesCloneNegativeTest-822469125 None] Lock "cinder-159668a9-a3a2-493e-972e-1f4c3f03f491-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d984e846-6a4c-4cc1-86f6-7f8b969d05ab req-e1c3275e-5517-4517-adec-cc0ac6b09653 tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d984e846-6a4c-4cc1-86f6-7f8b969d05ab req-e1c3275e-5517-4517-adec-cc0ac6b09653 tempest-TestStampPattern-1625162679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d984e846-6a4c-4cc1-86f6-7f8b969d05ab req-e1c3275e-5517-4517-adec-cc0ac6b09653 tempest-TestStampPattern-1625162679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d984e846-6a4c-4cc1-86f6-7f8b969d05ab req-e1c3275e-5517-4517-adec-cc0ac6b09653 tempest-TestStampPattern-1625162679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '824f40d3-e44b-492b-8bc1-eb2d3dc7d66a', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:23:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-d984e846-6a4c-4cc1-86f6-7f8b969d05ab req-e1c3275e-5517-4517-adec-cc0ac6b09653 tempest-TestStampPattern-1625162679 None] attachment_update completed successfully. Sep 25 16:23:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-aea561f4-88a5-4eb3-9d18-99c69247cdf6 req-89c282d5-2ab6-476c-98b0-bd9d328194d2 tempest-TestStampPattern-1625162679 None] Terminate volume connection completed successfully. Sep 25 16:23:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-aea561f4-88a5-4eb3-9d18-99c69247cdf6 req-89c282d5-2ab6-476c-98b0-bd9d328194d2 tempest-TestStampPattern-1625162679 None] Deleting attachment 824f40d3-e44b-492b-8bc1-eb2d3dc7d66a. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:23:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Acquiring lock "cinder-e94e34b4-5c71-421c-8c94-29040e2b0e7c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Lock "cinder-e94e34b4-5c71-421c-8c94-29040e2b0e7c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Acquiring lock "cinder-quobyte-e94e34b4-5c71-421c-8c94-29040e2b0e7c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-e94e34b4-5c71-421c-8c94-29040e2b0e7c" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78d603c-d707-4419-bcdb-afd29f258c24]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:35 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c Sep 25 16:23:35 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:35 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c" returned: 0 in 0.494s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:35 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c Sep 25 16:23:35 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:36 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e94e34b4-5c71-421c-8c94-29040e2b0e7c" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-e94e34b4-5c71-421c-8c94-29040e2b0e7c" released by "delete_volume" :: held 0.873s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Created reservations ['6af2c96e-7d52-49ef-ad56-9cf20c46cebb', '7a18cbf9-f96e-4e13-8746-686f227a98f7', '55a9aefd-18d7-431e-b035-dc1a91b8d7f8', 'a737b190-a89c-4806-a266-0340b064dcf2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:36 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:23:36 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:36 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Deleted volume successfully. Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-71b0aa77-1680-44d9-bfc1-16b77af447df tempest-TestStampPattern-1625162679 None] Lock "cinder-e94e34b4-5c71-421c-8c94-29040e2b0e7c-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Acquiring lock "cinder-9bb47fb5-a255-4b8b-964e-ff42dfc11dac-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Lock "cinder-9bb47fb5-a255-4b8b-964e-ff42dfc11dac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Acquiring lock "cinder-quobyte-4f6b83ab-c094-420f-ba72-ad7b711e94c8" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-4f6b83ab-c094-420f-ba72-ad7b711e94c8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Acquiring lock "cinder-quobyte-9bb47fb5-a255-4b8b-964e-ff42dfc11dac" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-9bb47fb5-a255-4b8b-964e-ff42dfc11dac" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Deleting offline snapshot 9bb47fb5-a255-4b8b-964e-ff42dfc11dac of volume 4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] snapshot_file for this snap is: volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec3480-62c3-43f0-8279-81c3ca185cee]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:37 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac Sep 25 16:23:37 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:37 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac" returned: 0 in 0.440s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a436b63c-878f-4f1b-8e28-70a4252cd726]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:37 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 Sep 25 16:23:37 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:38 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8" returned: 0 in 0.709s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:38 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac Sep 25 16:23:38 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:38 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:38 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac Sep 25 16:23:38 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:38 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8.9bb47fb5-a255-4b8b-964e-ff42dfc11dac" returned: 0 in 0.290s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-9bb47fb5-a255-4b8b-964e-ff42dfc11dac" released by "_delete_snapshot" :: held 1.958s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-4f6b83ab-c094-420f-ba72-ad7b711e94c8" released by "delete_snapshot" :: held 1.986s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Created reservations ['fd729c00-bdb4-4c8e-9871-b5d04e11271a', '6420812b-4d89-4e2c-bfd8-f242576c0553', 'd3471859-8bb1-4217-9591-7ada8f37ad08', '7804ed81-2709-40aa-9227-347f15ef5064'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Delete snapshot completed successfully. Sep 25 16:23:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce7ab5a8-a336-481a-961a-4ebfa5a86b63 tempest-TestStampPattern-1625162679 None] Lock "cinder-9bb47fb5-a255-4b8b-964e-ff42dfc11dac-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Acquiring lock "cinder-4f6b83ab-c094-420f-ba72-ad7b711e94c8-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Lock "cinder-4f6b83ab-c094-420f-ba72-ad7b711e94c8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:43 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=54,cinder:UPDATE=59,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:23:43 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=66,cinder:SELECT=44,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:23:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Acquiring lock "cinder-quobyte-4f6b83ab-c094-420f-ba72-ad7b711e94c8" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-4f6b83ab-c094-420f-ba72-ad7b711e94c8" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a4ec3-c116-43d3-9cf4-c82a19db938a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:43 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 Sep 25 16:23:43 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:44 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8" returned: 0 in 0.454s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:44 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8 Sep 25 16:23:44 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:44 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4f6b83ab-c094-420f-ba72-ad7b711e94c8" returned: 0 in 0.342s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Lock "cinder-quobyte-4f6b83ab-c094-420f-ba72-ad7b711e94c8" released by "delete_volume" :: held 0.877s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Created reservations ['62fea9d5-202f-4e6f-9ef0-85996fbca6d9', '18dc6d6b-8f6d-4f02-a870-710e4321bc5e', '83a18a0d-5b26-48e2-aca1-d73f95ede116', 'eef8dcd6-dba1-49e3-850f-22e2f4f1bd0e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:44 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:23:44 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:44 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.334s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Deleted volume successfully. Sep 25 16:23:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e67c43e0-6f66-47de-aff5-a6de2c750e09 tempest-TestStampPattern-1625162679 None] Lock "cinder-4f6b83ab-c094-420f-ba72-ad7b711e94c8-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:54 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:23:54 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:23:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:23:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:58 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:23:58 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:59 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:23:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:23:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Flow 'volume_create_manager' (9cf962d0-7600-42ce-b6ff-6a88599d7d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd1e2fa-0a8b-4f35-bc85-946c88be40f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd1e2fa-0a8b-4f35-bc85-946c88be40f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-509605787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b25698-38f8-4a54-9dde-4ff43af1d95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4d32732a124c5bb32c675c8a847022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:03Z,use_quota=True,user_id='9d8eb647eed34139aa9d3cdf8c464a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fea8ae-ceea-490d-acc0-0ed40c91f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fea8ae-ceea-490d-acc0-0ed40c91f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e7fdb9-e885-476c-b88d-3dd2dcb38482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e7fdb9-e885-476c-b88d-3dd2dcb38482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b25698-38f8-4a54-9dde-4ff43af1d95a', 'volume_name': 'volume-43b25698-38f8-4a54-9dde-4ff43af1d95a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a3f76e-9afe-4864-8de9-5fc72b55006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a3f76e-9afe-4864-8de9-5fc72b55006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8b64fb-bc45-48cc-b97b-f7c11d26b930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Volume 43b25698-38f8-4a54-9dde-4ff43af1d95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b25698-38f8-4a54-9dde-4ff43af1d95a', 'volume_size': 1} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-509605787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b25698-38f8-4a54-9dde-4ff43af1d95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4d32732a124c5bb32c675c8a847022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:03Z,use_quota=True,user_id='9d8eb647eed34139aa9d3cdf8c464a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Creating volume 43b25698-38f8-4a54-9dde-4ff43af1d95a {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:03 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:24:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:03 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a 1073741824 Sep 25 16:24:03 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:04 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a 1073741824" returned: 0 in 0.601s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:04 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a Sep 25 16:24:04 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:04 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8b64fb-bc45-48cc-b97b-f7c11d26b930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b25698-38f8-4a54-9dde-4ff43af1d95a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c854b16-3a9d-465a-8dd0-7fa16df31eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Volume volume-43b25698-38f8-4a54-9dde-4ff43af1d95a (43b25698-38f8-4a54-9dde-4ff43af1d95a): created successfully Sep 25 16:24:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c854b16-3a9d-465a-8dd0-7fa16df31eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Flow 'volume_create_manager' (9cf962d0-7600-42ce-b6ff-6a88599d7d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a3cb031f-5bb6-4957-80c1-425daab1dd19 tempest-TestMinimumBasicScenario-520418345 None] Created volume successfully. Sep 25 16:24:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-a22fb689-2157-4120-b3a4-88307cb7f6e5 req-6beab23f-159c-4bf1-ac1f-1e3bebfb189a tempest-TestMinimumBasicScenario-520418345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-a22fb689-2157-4120-b3a4-88307cb7f6e5 req-6beab23f-159c-4bf1-ac1f-1e3bebfb189a tempest-TestMinimumBasicScenario-520418345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-a22fb689-2157-4120-b3a4-88307cb7f6e5 req-6beab23f-159c-4bf1-ac1f-1e3bebfb189a tempest-TestMinimumBasicScenario-520418345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-a22fb689-2157-4120-b3a4-88307cb7f6e5 req-6beab23f-159c-4bf1-ac1f-1e3bebfb189a tempest-TestMinimumBasicScenario-520418345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99', 'name': 'volume-43b25698-38f8-4a54-9dde-4ff43af1d95a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50862092-c92e-42e1-ac92-f3d797d93b81', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:24:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-a22fb689-2157-4120-b3a4-88307cb7f6e5 req-6beab23f-159c-4bf1-ac1f-1e3bebfb189a tempest-TestMinimumBasicScenario-520418345 None] attachment_update completed successfully. Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Flow 'volume_create_manager' (86090439-29d9-4156-be3a-2c3da528122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c20ce6-f332-42e4-94f2-56b3642124ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c20ce6-f332-42e4-94f2-56b3642124ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d53194f-e7eb-4cc2-bb1a-93726254a505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e56795dde4425689193f163faedd17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:09Z,use_quota=True,user_id='00498d32af814a21b49e31846d0b5553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a267e7f-05cf-4048-b7a2-286b4037a17f),volume_type_id=3a267e7f-05cf-4048-b7a2-286b4037a17f)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ba5283-7344-468c-9667-b76df81b4665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ba5283-7344-468c-9667-b76df81b4665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ccac50-a604-44c1-ae4a-894366772668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ccac50-a604-44c1-ae4a-894366772668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d53194f-e7eb-4cc2-bb1a-93726254a505', 'volume_name': 'volume-1d53194f-e7eb-4cc2-bb1a-93726254a505', 'volume_size': 1, 'image_id': '23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff71f3c582a43434a882f3101c43c59d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12e56795dde4425689193f163faedd17', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5c5815a377e33dcfaaac4d566eb3f1d9434131694250b6e54ccc5250746f6172eaf1f9145047d5b5236facc5b0e63ed1d3d668aeef99ba02ec5707da62d34e8', 'id': '23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'created_at': datetime.datetime(2026, 9, 25, 14, 24, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 24, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23ee95c2-7139-4553-9105-7ff7a1e99f6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8fb9fb-2499-41bb-b83d-62b4203714ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8fb9fb-2499-41bb-b83d-62b4203714ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee672d16-86d0-4671-a74a-2c915f637861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Volume 1d53194f-e7eb-4cc2-bb1a-93726254a505: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d53194f-e7eb-4cc2-bb1a-93726254a505', 'volume_size': 1, 'image_id': '23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff71f3c582a43434a882f3101c43c59d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12e56795dde4425689193f163faedd17', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5c5815a377e33dcfaaac4d566eb3f1d9434131694250b6e54ccc5250746f6172eaf1f9145047d5b5236facc5b0e63ed1d3d668aeef99ba02ec5707da62d34e8', 'id': '23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'created_at': datetime.datetime(2026, 9, 25, 14, 24, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 24, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23ee95c2-7139-4553-9105-7ff7a1e99f6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Trying to clone 1d53194f-e7eb-4cc2-bb1a-93726254a505 from image 23ee95c2-7139-4553-9105-7ff7a1e99f6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:24:09 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dcaa73-979b-44d1-a96b-e6d12b02c8f6]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:09 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD Sep 25 16:24:09 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:10 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:10 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD Sep 25 16:24:10 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:10 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD" returned: 1 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:24:10 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Temporary image 23ee95c2-7139-4553-9105-7ff7a1e99f6d is fetched for user 00498d32af814a21b49e31846d0b5553. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:24:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a36a29-af01-4c43-bb88-09ca86a7253c]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:10 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD Sep 25 16:24:10 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:11 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:11 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD Sep 25 16:24:11 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:11 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD" returned: 1 in 0.441s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d53194f-e7eb-4cc2-bb1a-93726254a505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e56795dde4425689193f163faedd17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:09Z,use_quota=True,user_id='00498d32af814a21b49e31846d0b5553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a267e7f-05cf-4048-b7a2-286b4037a17f),volume_type_id=3a267e7f-05cf-4048-b7a2-286b4037a17f)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Creating volume 1d53194f-e7eb-4cc2-bb1a-93726254a505 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:24:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:11 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 1073741824 Sep 25 16:24:11 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:12 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 1073741824" returned: 0 in 0.633s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:12 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 Sep 25 16:24:12 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:12 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505" returned: 0 in 0.273s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:12 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Attempting download of 23ee95c2-7139-4553-9105-7ff7a1e99f6d ((None, [{'url': 'file:///opt/stack/data/glance/images/23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'metadata': {}}])) to volume 1d53194f-e7eb-4cc2-bb1a-93726254a505. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:24:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d552a-f8f3-4442-b05a-06a4875529b4]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23ee95c2-7139-4553-9105-7ff7a1e99f6d_h353doqk {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:12 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23ee95c2-7139-4553-9105-7ff7a1e99f6d_h353doqk Sep 25 16:24:12 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:12 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23ee95c2-7139-4553-9105-7ff7a1e99f6d_h353doqk" returned: 0 in 0.448s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23ee95c2-7139-4553-9105-7ff7a1e99f6d_h353doqk {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:13 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23ee95c2-7139-4553-9105-7ff7a1e99f6d_h353doqk Sep 25 16:24:13 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:13 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23ee95c2-7139-4553-9105-7ff7a1e99f6d_h353doqk" returned: 1 in 0.569s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23ee95c2-7139-4553-9105-7ff7a1e99f6d_h353doqk' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:24:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a224ef83-b5b3-4566-95ae-5885ca8290e0]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:13 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD Sep 25 16:24:13 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:14 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:14 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD Sep 25 16:24:14 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:14 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD" returned: 1 in 0.462s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:24:14 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] 23ee95c2-7139-4553-9105-7ff7a1e99f6d was raw, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1150}} Sep 25 16:24:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:14 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 Sep 25 16:24:14 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:15 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505" returned: 0 in 0.679s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23ee95c2-7139-4553-9105-7ff7a1e99f6d_az7699okdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:24:15 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:15 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 1G Sep 25 16:24:15 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:15 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 1G" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Downloaded image 23ee95c2-7139-4553-9105-7ff7a1e99f6d ((None, [{'url': 'file:///opt/stack/data/glance/images/23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'metadata': {}}])) to volume 1d53194f-e7eb-4cc2-bb1a-93726254a505 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Temporary image 23ee95c2-7139-4553-9105-7ff7a1e99f6d for user 00498d32af814a21b49e31846d0b5553 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Marking volume 1d53194f-e7eb-4cc2-bb1a-93726254a505 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Copying metadata from image 23ee95c2-7139-4553-9105-7ff7a1e99f6d to 1d53194f-e7eb-4cc2-bb1a-93726254a505. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Creating volume glance metadata for volume 1d53194f-e7eb-4cc2-bb1a-93726254a505 backed by image 23ee95c2-7139-4553-9105-7ff7a1e99f6d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ff71f3c582a43434a882f3101c43c59d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee672d16-86d0-4671-a74a-2c915f637861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d53194f-e7eb-4cc2-bb1a-93726254a505', 'volume_size': 1, 'image_id': '23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff71f3c582a43434a882f3101c43c59d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12e56795dde4425689193f163faedd17', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5c5815a377e33dcfaaac4d566eb3f1d9434131694250b6e54ccc5250746f6172eaf1f9145047d5b5236facc5b0e63ed1d3d668aeef99ba02ec5707da62d34e8', 'id': '23ee95c2-7139-4553-9105-7ff7a1e99f6d', 'created_at': datetime.datetime(2026, 9, 25, 14, 24, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 24, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23ee95c2-7139-4553-9105-7ff7a1e99f6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec5f98e-b782-4acb-9359-05278b9439e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Volume volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 (1d53194f-e7eb-4cc2-bb1a-93726254a505): created successfully Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec5f98e-b782-4acb-9359-05278b9439e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Flow 'volume_create_manager' (86090439-29d9-4156-be3a-2c3da528122b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8f58f740-2e40-410c-925d-1e032a0195e3 tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Created volume successfully. Sep 25 16:24:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Acquiring lock "cinder-1d53194f-e7eb-4cc2-bb1a-93726254a505-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "cinder-1d53194f-e7eb-4cc2-bb1a-93726254a505-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Acquiring lock "cinder-quobyte-1d53194f-e7eb-4cc2-bb1a-93726254a505" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "cinder-quobyte-1d53194f-e7eb-4cc2-bb1a-93726254a505" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7689c4-490b-4941-9835-2a8e1353aab7]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:17 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 Sep 25 16:24:17 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:17 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505" returned: 0 in 0.497s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:17 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505 Sep 25 16:24:17 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:17 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d53194f-e7eb-4cc2-bb1a-93726254a505" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "cinder-quobyte-1d53194f-e7eb-4cc2-bb1a-93726254a505" released by "delete_volume" :: held 0.865s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:17 devstack cinder-volume[87314]: WARNING cinder.quota [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:24:17 devstack cinder-volume[87314]: WARNING cinder.quota [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Created reservations ['30490c28-5a25-45c5-8bbf-50615c12f651', '11d620b2-d22d-4a64-8099-d92088d59cd0', '3d16b9b3-4111-4a14-a16e-bb1bbb7f24ed', '8babe26b-0b54-42a0-874f-df2621858e5b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:17 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:24:17 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:18 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:18 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Deleted volume successfully. Sep 25 16:24:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2dc2da14-cb1e-4408-9ef6-e9fcec15d55d tempest-VolumeAndVolumeTypeFromImageTest-1026032146 None] Lock "cinder-1d53194f-e7eb-4cc2-bb1a-93726254a505-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Flow 'volume_create_manager' (40294c74-d31a-41a6-b0e9-6076e89fdcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfad3a8-0ea8-427c-8c12-45a78170ae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfad3a8-0ea8-427c-8c12-45a78170ae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1936998547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d5cb014bb406fb1a6470815ff8139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:24Z,use_quota=True,user_id='eeaa6734a37e48689d9e98d7f74aa441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86864685-51ad-4634-b7e1-4e771707f1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86864685-51ad-4634-b7e1-4e771707f1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6dd941-8026-4b67-9192-7d9d4f289f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6dd941-8026-4b67-9192-7d9d4f289f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ec1ba5-8420-4226-bcd1-ae864d6bc8ac', 'volume_name': 'volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253503f4-bf9d-459c-8f8e-b8bca500b1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253503f4-bf9d-459c-8f8e-b8bca500b1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ea15d8-df5a-4853-9219-4cabcafcd826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Volume d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac', 'volume_size': 1} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1936998547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d5cb014bb406fb1a6470815ff8139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:24Z,use_quota=True,user_id='eeaa6734a37e48689d9e98d7f74aa441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Creating volume d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:23 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:24:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:23 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac 1073741824 Sep 25 16:24:23 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:24 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac 1073741824" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:24 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac Sep 25 16:24:24 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:24 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ea15d8-df5a-4853-9219-4cabcafcd826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7b75a6-9424-4602-a951-081fcc44e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:24 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Volume volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac (d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac): created successfully Sep 25 16:24:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7b75a6-9424-4602-a951-081fcc44e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Flow 'volume_create_manager' (40294c74-d31a-41a6-b0e9-6076e89fdcad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d1ff6eb4-e023-48fb-be67-f6e576249cc5 tempest-ProjectReaderTests-768493903 None] Created volume successfully. Sep 25 16:24:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Acquiring lock "cinder-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Lock "cinder-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Acquiring lock "cinder-quobyte-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Lock "cinder-quobyte-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2fa2da-b49f-46d7-adfc-a89dc518a9d7]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:26 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac Sep 25 16:24:26 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:26 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac" returned: 0 in 0.387s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:26 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac Sep 25 16:24:26 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:26 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Lock "cinder-quobyte-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac" released by "delete_volume" :: held 0.702s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Created reservations ['130b3288-3587-4f1c-99a0-81e811bc2327', '46d7baed-f628-4dbd-9b2f-516bd86ec46c', '9a3b3d94-5c7a-4d16-a550-50ce559f4a6e', 'b453342d-b72a-44ae-9410-c23b8326c5f6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:26 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:24:26 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:27 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Deleted volume successfully. Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-76650a0a-85a3-425f-b27a-2a1a08d3ae6e tempest-ProjectReaderTests-768493903 None] Lock "cinder-d9ec1ba5-8420-4226-bcd1-ae864d6bc8ac-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Flow 'volume_create_manager' (c2bfef37-6385-4be4-909a-40b2a7f36e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9d799e-0816-415a-8892-6f99b8e6a7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9d799e-0816-415a-8892-6f99b8e6a7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623386471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83e5ec2-6855-4822-803a-53f488c9176f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d5cb014bb406fb1a6470815ff8139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:28Z,use_quota=True,user_id='eeaa6734a37e48689d9e98d7f74aa441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1ad2e4-eba5-4de9-a819-81e715e536ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1ad2e4-eba5-4de9-a819-81e715e536ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5d1fd0-cd03-4ed2-91e8-7e7e33d8f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5d1fd0-cd03-4ed2-91e8-7e7e33d8f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83e5ec2-6855-4822-803a-53f488c9176f', 'volume_name': 'volume-e83e5ec2-6855-4822-803a-53f488c9176f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66503f4b-5edb-4b00-b773-f7c63261e654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66503f4b-5edb-4b00-b773-f7c63261e654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964d333a-c93c-405c-a304-bbc1739887fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Volume e83e5ec2-6855-4822-803a-53f488c9176f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83e5ec2-6855-4822-803a-53f488c9176f', 'volume_size': 1} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623386471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83e5ec2-6855-4822-803a-53f488c9176f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d5cb014bb406fb1a6470815ff8139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:28Z,use_quota=True,user_id='eeaa6734a37e48689d9e98d7f74aa441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Creating volume e83e5ec2-6855-4822-803a-53f488c9176f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:27 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:24:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:27 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f 1073741824 Sep 25 16:24:27 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:28 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f 1073741824" returned: 0 in 0.607s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:28 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f Sep 25 16:24:28 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:28 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964d333a-c93c-405c-a304-bbc1739887fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83e5ec2-6855-4822-803a-53f488c9176f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94be495-2d47-46dd-a9ac-358c5f14a6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Volume volume-e83e5ec2-6855-4822-803a-53f488c9176f (e83e5ec2-6855-4822-803a-53f488c9176f): created successfully Sep 25 16:24:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94be495-2d47-46dd-a9ac-358c5f14a6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Flow 'volume_create_manager' (c2bfef37-6385-4be4-909a-40b2a7f36e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0e835681-feb7-464f-80fd-5d6298080385 tempest-ProjectReaderTests-768493903 None] Created volume successfully. Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Acquiring lock "cinder-e83e5ec2-6855-4822-803a-53f488c9176f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Lock "cinder-e83e5ec2-6855-4822-803a-53f488c9176f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Acquiring lock "cinder-quobyte-e83e5ec2-6855-4822-803a-53f488c9176f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Lock "cinder-quobyte-e83e5ec2-6855-4822-803a-53f488c9176f" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8443fcc7-a8e9-449a-9e9e-c2eb0b769591]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:30 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f Sep 25 16:24:30 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:30 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f" returned: 0 in 0.387s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:30 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f Sep 25 16:24:30 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:30 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e83e5ec2-6855-4822-803a-53f488c9176f" returned: 0 in 0.348s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Lock "cinder-quobyte-e83e5ec2-6855-4822-803a-53f488c9176f" released by "delete_volume" :: held 0.803s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:30 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Created reservations ['88c150b3-dca8-4ba0-9272-fa8fd2be6bc5', 'ef6d2d9e-9f5e-4c09-984c-f7ed53d9aa62', '72bf03d4-52c4-494f-9e09-e1ebd4fe7d78', '31d81c1e-5e61-45c6-af7d-cbcefa5e9f57'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:31 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:24:31 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:31 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Deleted volume successfully. Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e7ecd3e-e98d-449e-99b8-10952ad1b67a tempest-ProjectReaderTests-768493903 None] Lock "cinder-e83e5ec2-6855-4822-803a-53f488c9176f-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Flow 'volume_create_manager' (b6e9a5cb-f92f-4bbc-9ed0-b275004f3b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa15567-fbeb-4d1c-a12d-f526e98fc170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa15567-fbeb-4d1c-a12d-f526e98fc170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456827409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd6f265-aa9a-4857-a55a-a48cac1f67cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d5cb014bb406fb1a6470815ff8139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:32Z,use_quota=True,user_id='eeaa6734a37e48689d9e98d7f74aa441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288bf821-213d-455f-b02e-5a07030a285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288bf821-213d-455f-b02e-5a07030a285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85acc3e6-68bf-46ba-a5d8-246801a660ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85acc3e6-68bf-46ba-a5d8-246801a660ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd6f265-aa9a-4857-a55a-a48cac1f67cd', 'volume_name': 'volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf7d228-b842-4bdd-8a5e-3a2a41ea8fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf7d228-b842-4bdd-8a5e-3a2a41ea8fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349499e5-8d52-4ca2-bfda-077d1184b9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Volume 4fd6f265-aa9a-4857-a55a-a48cac1f67cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd', 'volume_size': 1} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456827409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd6f265-aa9a-4857-a55a-a48cac1f67cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d5cb014bb406fb1a6470815ff8139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:32Z,use_quota=True,user_id='eeaa6734a37e48689d9e98d7f74aa441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Creating volume 4fd6f265-aa9a-4857-a55a-a48cac1f67cd {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:31 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:24:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:31 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd 1073741824 Sep 25 16:24:31 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:32 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd 1073741824" returned: 0 in 0.517s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:32 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd Sep 25 16:24:32 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:32 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349499e5-8d52-4ca2-bfda-077d1184b9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e270ec8-b372-4afe-ad79-ee8bbce1efbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Volume volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd (4fd6f265-aa9a-4857-a55a-a48cac1f67cd): created successfully Sep 25 16:24:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e270ec8-b372-4afe-ad79-ee8bbce1efbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Flow 'volume_create_manager' (b6e9a5cb-f92f-4bbc-9ed0-b275004f3b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-34f2335a-57bb-4aa7-bc80-b281bc2f2f4d tempest-ProjectReaderTests-768493903 None] Created volume successfully. Sep 25 16:24:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Acquiring lock "cinder-4fd6f265-aa9a-4857-a55a-a48cac1f67cd-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Lock "cinder-4fd6f265-aa9a-4857-a55a-a48cac1f67cd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Acquiring lock "cinder-quobyte-4fd6f265-aa9a-4857-a55a-a48cac1f67cd" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Lock "cinder-quobyte-4fd6f265-aa9a-4857-a55a-a48cac1f67cd" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ec9e87-7386-4ecf-b778-7dedc5b4f777]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:34 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd Sep 25 16:24:34 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:34 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:34 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd Sep 25 16:24:34 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:34 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4fd6f265-aa9a-4857-a55a-a48cac1f67cd" returned: 0 in 0.280s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Lock "cinder-quobyte-4fd6f265-aa9a-4857-a55a-a48cac1f67cd" released by "delete_volume" :: held 0.759s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:34 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Created reservations ['7a20ef65-4229-4307-9d0a-07b7690a17b8', 'c4065182-3c2c-4018-949a-c7ccbb46afd1', '63b92705-c94c-4a03-b078-d69e29e34f09', '1adadceb-4720-4da4-b9ab-2925b75f2a60'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:35 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:24:35 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:35 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.291s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Deleted volume successfully. Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-674dc6e0-f256-4152-8281-c6d3ef6ff0d7 tempest-ProjectReaderTests-768493903 None] Lock "cinder-4fd6f265-aa9a-4857-a55a-a48cac1f67cd-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Flow 'volume_create_manager' (26d47c10-f34a-4eca-a9e3-02acacbdcf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d35b1b3-fb3d-43de-9963-13d219cff47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d35b1b3-fb3d-43de-9963-13d219cff47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443412744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9a156e-2c26-4261-8ed3-b34418741b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d5cb014bb406fb1a6470815ff8139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:36Z,use_quota=True,user_id='eeaa6734a37e48689d9e98d7f74aa441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798e9042-8a83-43da-98fa-6c5c8f39189b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798e9042-8a83-43da-98fa-6c5c8f39189b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a375dde6-01a5-4559-8a09-f6e62f34df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a375dde6-01a5-4559-8a09-f6e62f34df8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9a156e-2c26-4261-8ed3-b34418741b85', 'volume_name': 'volume-0f9a156e-2c26-4261-8ed3-b34418741b85', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f4c4a7-0b6c-4069-b063-eb71ae3e54bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f4c4a7-0b6c-4069-b063-eb71ae3e54bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45458bc-e901-40a0-bc02-7958b0883404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Volume 0f9a156e-2c26-4261-8ed3-b34418741b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9a156e-2c26-4261-8ed3-b34418741b85', 'volume_size': 1} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443412744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9a156e-2c26-4261-8ed3-b34418741b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6d5cb014bb406fb1a6470815ff8139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:36Z,use_quota=True,user_id='eeaa6734a37e48689d9e98d7f74aa441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Creating volume 0f9a156e-2c26-4261-8ed3-b34418741b85 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:36 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85 1073741824 Sep 25 16:24:36 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:36 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85 1073741824" returned: 0 in 0.553s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:36 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85 Sep 25 16:24:36 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:36 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45458bc-e901-40a0-bc02-7958b0883404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9a156e-2c26-4261-8ed3-b34418741b85', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0580749-1077-4d75-b397-3ad3099f240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Volume volume-0f9a156e-2c26-4261-8ed3-b34418741b85 (0f9a156e-2c26-4261-8ed3-b34418741b85): created successfully Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0580749-1077-4d75-b397-3ad3099f240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Flow 'volume_create_manager' (26d47c10-f34a-4eca-a9e3-02acacbdcf38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e4bc813a-8ffa-436a-96ea-07be57533617 tempest-ProjectReaderTests-768493903 None] Created volume successfully. Sep 25 16:24:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Acquiring lock "cinder-0f9a156e-2c26-4261-8ed3-b34418741b85-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Lock "cinder-0f9a156e-2c26-4261-8ed3-b34418741b85-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Acquiring lock "cinder-quobyte-0f9a156e-2c26-4261-8ed3-b34418741b85" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Lock "cinder-quobyte-0f9a156e-2c26-4261-8ed3-b34418741b85" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b439295-58c3-4e24-9b69-e50266cfd497]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:38 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85 Sep 25 16:24:38 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:38 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85" returned: 0 in 0.511s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:38 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85 Sep 25 16:24:38 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:39 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f9a156e-2c26-4261-8ed3-b34418741b85" returned: 0 in 0.299s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Lock "cinder-quobyte-0f9a156e-2c26-4261-8ed3-b34418741b85" released by "delete_volume" :: held 0.873s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Created reservations ['587dfe5f-33a0-4f74-a84d-060fad765aa7', 'f9430c96-3f2b-4b29-8ffa-5f274df519c1', '8be34437-b876-41a1-b577-4774813b0c0a', '361a0bd5-1068-46fb-a7c0-83d8ed67b0fb'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:39 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:24:39 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:39 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Deleted volume successfully. Sep 25 16:24:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a09cad38-1530-4ff7-ad00-8f3fe93cdf66 tempest-ProjectReaderTests-768493903 None] Lock "cinder-0f9a156e-2c26-4261-8ed3-b34418741b85-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:49 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=52,cinder:UPDATE=61,cinder:DELETE=6,cinder:INSERT=17 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:24:49 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=61,cinder:INSERT=19,cinder:SELECT=47,cinder:DELETE=5 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:24:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-ad6e88d7-2e50-4ead-bba8-e9250965ff7b req-adaeb84a-4093-48d8-a82b-3377a1c56b2f tempest-TestMinimumBasicScenario-520418345 None] Terminate volume connection completed successfully. Sep 25 16:24:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-ad6e88d7-2e50-4ead-bba8-e9250965ff7b req-adaeb84a-4093-48d8-a82b-3377a1c56b2f tempest-TestMinimumBasicScenario-520418345 None] Deleting attachment 50862092-c92e-42e1-ac92-f3d797d93b81. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:24:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Acquiring lock "cinder-43b25698-38f8-4a54-9dde-4ff43af1d95a-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Lock "cinder-43b25698-38f8-4a54-9dde-4ff43af1d95a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Acquiring lock "cinder-quobyte-43b25698-38f8-4a54-9dde-4ff43af1d95a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Lock "cinder-quobyte-43b25698-38f8-4a54-9dde-4ff43af1d95a" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64a68be-a42a-49e9-b474-c2150499b3c6]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:55 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a Sep 25 16:24:55 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:56 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a" returned: 0 in 0.470s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:56 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a Sep 25 16:24:56 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:56 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-43b25698-38f8-4a54-9dde-4ff43af1d95a" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Lock "cinder-quobyte-43b25698-38f8-4a54-9dde-4ff43af1d95a" released by "delete_volume" :: held 0.784s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Created reservations ['520d9838-a971-48e3-b537-3bd41a81ed36', 'ee1fed37-71f2-450b-b8b2-1368497cd8c8', '741d601d-a37a-4487-a4e6-4dcfa50615b4', 'bf63f082-9090-4647-ba61-96994e7e3e55'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:56 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:24:56 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:56 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Deleted volume successfully. Sep 25 16:24:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9409fdc-c883-4f51-8282-23a1c39e96b5 tempest-TestMinimumBasicScenario-520418345 None] Lock "cinder-43b25698-38f8-4a54-9dde-4ff43af1d95a-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:58 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:24:58 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:58 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.275s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:24:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:25:06 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:25:06 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (06c60862-8c0a-4e1e-ab25-0028386e5673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963400db-4c4e-4f14-a407-6ab50b23260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963400db-4c4e-4f14-a407-6ab50b23260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-627228463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2a0856-ec06-4d85-9c12-5c27da0a1fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:13Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8717f0-e1a3-489e-8096-64fa59d48bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8717f0-e1a3-489e-8096-64fa59d48bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e1da4f-5c3a-49d0-80c7-e5b5244c9b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e1da4f-5c3a-49d0-80c7-e5b5244c9b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2a0856-ec06-4d85-9c12-5c27da0a1fae', 'volume_name': 'volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04a6e31-0c8c-4863-bc5b-9077d8b56b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04a6e31-0c8c-4863-bc5b-9077d8b56b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c9e61d-a73b-40e4-ae64-a792c5c80f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Volume 6b2a0856-ec06-4d85-9c12-5c27da0a1fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae', 'volume_size': 1} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-627228463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2a0856-ec06-4d85-9c12-5c27da0a1fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:13Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Creating volume 6b2a0856-ec06-4d85-9c12-5c27da0a1fae {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:13 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:13 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae 1073741824 Sep 25 16:25:13 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (bbb54f35-cbaf-4702-baa6-b2fb84f5715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5021266d-9acd-4c8d-b632-d07046d39d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5021266d-9acd-4c8d-b632-d07046d39d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-792925686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:14Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e756c8-2613-4cdb-9ee1-02303f6caabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e756c8-2613-4cdb-9ee1-02303f6caabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6177050f-e22d-4539-a450-6a70c65bba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6177050f-e22d-4539-a450-6a70c65bba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e', 'volume_name': 'volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbfbfc2-f85f-4de9-9b51-641c9a6700e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbfbfc2-f85f-4de9-9b51-641c9a6700e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8064a7c5-3d50-4eab-89aa-1da316a04944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Volume 1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e', 'volume_size': 1} Sep 25 16:25:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:14 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae 1073741824" returned: 0 in 0.538s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:14 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae Sep 25 16:25:14 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (7b708352-e958-408b-9341-3258498a99cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a4918e-3665-4021-9e21-ccde1266face) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a4918e-3665-4021-9e21-ccde1266face) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918475666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1441f8d-2961-461f-a67c-6fd45b0bbe01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:14Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ebf6f-9b21-4d77-a1c0-62f8cea811af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ebf6f-9b21-4d77-a1c0-62f8cea811af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776ac4b7-a0f9-4710-87a1-86fafb4a30fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776ac4b7-a0f9-4710-87a1-86fafb4a30fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1441f8d-2961-461f-a67c-6fd45b0bbe01', 'volume_name': 'volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee6ba37-f728-48e4-8733-6fb1704b5c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee6ba37-f728-48e4-8733-6fb1704b5c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08afaddf-b7c5-472b-a18c-c4cfad3d63be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Volume b1441f8d-2961-461f-a67c-6fd45b0bbe01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01', 'volume_size': 1} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:14 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae" returned: 0 in 0.323s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-792925686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:14Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Creating volume 1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:14 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c9e61d-a73b-40e4-ae64-a792c5c80f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1790a4-d681-49cb-ac41-748cfbddffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e 1073741824 Sep 25 16:25:14 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Volume volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae (6b2a0856-ec06-4d85-9c12-5c27da0a1fae): created successfully Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1790a4-d681-49cb-ac41-748cfbddffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (06c60862-8c0a-4e1e-ab25-0028386e5673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ee1452b5-4c69-4dd7-b997-78a8c01f9d85 tempest-CreateVolumesFromImageTest-1611120245 None] Created volume successfully. Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (84b203f5-5d11-4a25-91ea-e1aec0e458da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f6e11c-740e-4c9e-9974-a8b6b2986c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f6e11c-740e-4c9e-9974-a8b6b2986c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1764834145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee09f58-edf8-4e12-a827-06dbcfcdfa67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:15Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fe7b89-3ffc-4478-88ca-16d8e7f974a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fe7b89-3ffc-4478-88ca-16d8e7f974a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3899511a-e7a3-4bbc-abea-fa5a3c24c80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3899511a-e7a3-4bbc-abea-fa5a3c24c80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee09f58-edf8-4e12-a827-06dbcfcdfa67', 'volume_name': 'volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99387228-cf5f-40cf-83db-3eb2b923962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99387228-cf5f-40cf-83db-3eb2b923962a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabb6690-0993-4549-bfb6-46ece7f3d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Volume dee09f58-edf8-4e12-a827-06dbcfcdfa67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67', 'volume_size': 1} Sep 25 16:25:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:15 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e 1073741824" returned: 0 in 0.563s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:15 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e Sep 25 16:25:15 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (d891934e-fb9b-43f8-b3cd-55bf7d82cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046a80cf-997d-4988-ba5b-c798c0fefc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046a80cf-997d-4988-ba5b-c798c0fefc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543536268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb3112b-ba02-4bbf-9d96-225c70e22154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:15Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb011d95-4617-434c-a079-ac6855cf2846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb011d95-4617-434c-a079-ac6855cf2846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d85524-a83a-492c-bfd8-7d69d3f77e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d85524-a83a-492c-bfd8-7d69d3f77e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb3112b-ba02-4bbf-9d96-225c70e22154', 'volume_name': 'volume-bdb3112b-ba02-4bbf-9d96-225c70e22154', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3123eec8-693e-4109-bcdd-8e49d6d8e3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3123eec8-693e-4109-bcdd-8e49d6d8e3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0984fd4d-4254-44c4-bd46-7edf82ac132f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Volume bdb3112b-ba02-4bbf-9d96-225c70e22154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb3112b-ba02-4bbf-9d96-225c70e22154', 'volume_size': 1} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:15 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e" returned: 0 in 0.280s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918475666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1441f8d-2961-461f-a67c-6fd45b0bbe01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:14Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Creating volume b1441f8d-2961-461f-a67c-6fd45b0bbe01 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:15 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8064a7c5-3d50-4eab-89aa-1da316a04944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11169c-ffb7-49ff-9370-263d5d3f51d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:15 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 1073741824 Sep 25 16:25:15 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Volume volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e (1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e): created successfully Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11169c-ffb7-49ff-9370-263d5d3f51d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (bbb54f35-cbaf-4702-baa6-b2fb84f5715b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7757c3fe-18a5-4353-8ad6-2345f548a137 tempest-CreateVolumesFromImageTest-1611120245 None] Created volume successfully. Sep 25 16:25:15 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 1073741824" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:15 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 Sep 25 16:25:15 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:16 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1764834145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee09f58-edf8-4e12-a827-06dbcfcdfa67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:15Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Creating volume dee09f58-edf8-4e12-a827-06dbcfcdfa67 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:16 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08afaddf-b7c5-472b-a18c-c4cfad3d63be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a384db70-bfd1-4f8b-961e-a329eb5a55fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:16 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 1073741824 Sep 25 16:25:16 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Volume volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 (b1441f8d-2961-461f-a67c-6fd45b0bbe01): created successfully Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a384db70-bfd1-4f8b-961e-a329eb5a55fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (7b708352-e958-408b-9341-3258498a99cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9fcdfe2d-be63-47f3-9bd5-1934127e9044 tempest-CreateVolumesFromImageTest-1611120245 None] Created volume successfully. Sep 25 16:25:16 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 1073741824" returned: 0 in 0.480s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:16 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 Sep 25 16:25:16 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:16 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543536268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb3112b-ba02-4bbf-9d96-225c70e22154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa0e5dcd504f87be0c64b8728364f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:15Z,use_quota=True,user_id='e955c274fd9347bfa4981053263c323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Creating volume bdb3112b-ba02-4bbf-9d96-225c70e22154 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:16 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabb6690-0993-4549-bfb6-46ece7f3d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e383bb-2982-4264-bb82-ac1de11da2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:16 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 1073741824 Sep 25 16:25:16 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Volume volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 (dee09f58-edf8-4e12-a827-06dbcfcdfa67): created successfully Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e383bb-2982-4264-bb82-ac1de11da2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (84b203f5-5d11-4a25-91ea-e1aec0e458da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d063dabb-1855-49c8-8375-23d9566b5c3b tempest-CreateVolumesFromImageTest-1611120245 None] Created volume successfully. Sep 25 16:25:17 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 1073741824" returned: 0 in 0.506s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:17 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 Sep 25 16:25:17 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:17 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0984fd4d-4254-44c4-bd46-7edf82ac132f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb3112b-ba02-4bbf-9d96-225c70e22154', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e3719c-f87f-465a-b101-2a4c49a4a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:17 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Volume volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 (bdb3112b-ba02-4bbf-9d96-225c70e22154): created successfully Sep 25 16:25:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e3719c-f87f-465a-b101-2a4c49a4a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Flow 'volume_create_manager' (d891934e-fb9b-43f8-b3cd-55bf7d82cb01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b0acd35e-7a78-416b-ae9a-517fcf7d6022 tempest-CreateVolumesFromImageTest-1611120245 None] Created volume successfully. Sep 25 16:25:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-bdb3112b-ba02-4bbf-9d96-225c70e22154-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-bdb3112b-ba02-4bbf-9d96-225c70e22154-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-quobyte-bdb3112b-ba02-4bbf-9d96-225c70e22154" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-bdb3112b-ba02-4bbf-9d96-225c70e22154" acquired by "delete_volume" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c47d14-ddd1-4bb8-89c4-d5adcd4beb8f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:18 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 Sep 25 16:25:18 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:19 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:19 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154 Sep 25 16:25:19 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:19 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bdb3112b-ba02-4bbf-9d96-225c70e22154" returned: 0 in 0.252s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-bdb3112b-ba02-4bbf-9d96-225c70e22154" released by "delete_volume" :: held 0.682s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Created reservations ['1bc6245a-2287-44d7-a077-c7f8e767c29b', '1f0e907e-52c5-40fe-89f6-1ef47fcfbf29', '983ebe84-b678-480e-997b-c766c6cda376', '45880168-d842-4e28-9d0c-c926106c29e9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:19 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:19 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:19 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.280s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Deleted volume successfully. Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-dee09f58-edf8-4e12-a827-06dbcfcdfa67-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-dee09f58-edf8-4e12-a827-06dbcfcdfa67-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81a9cedc-c7f4-460e-87bf-6e10ed58f4f6 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-bdb3112b-ba02-4bbf-9d96-225c70e22154-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-quobyte-dee09f58-edf8-4e12-a827-06dbcfcdfa67" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-dee09f58-edf8-4e12-a827-06dbcfcdfa67" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9cd4dd-c89f-4d5c-8393-45fb3695394c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:20 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 Sep 25 16:25:20 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:20 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67" returned: 0 in 0.393s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:20 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67 Sep 25 16:25:20 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:20 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-dee09f58-edf8-4e12-a827-06dbcfcdfa67" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-dee09f58-edf8-4e12-a827-06dbcfcdfa67" released by "delete_volume" :: held 0.697s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Created reservations ['e3ee8d40-fece-49c2-a739-cb5000695255', '5db9a0fc-3410-46d9-b311-27292e77f99a', '5bc5e6eb-0f2e-4e3c-9863-e540680d1718', 'a67e43e7-bb60-4782-88cf-89fedfd03e6e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:20 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:20 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:20 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-b1441f8d-2961-461f-a67c-6fd45b0bbe01-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Deleted volume successfully. Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-b1441f8d-2961-461f-a67c-6fd45b0bbe01-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5c827484-af92-4e4f-845f-246fbf4d2932 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-dee09f58-edf8-4e12-a827-06dbcfcdfa67-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-quobyte-b1441f8d-2961-461f-a67c-6fd45b0bbe01" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-b1441f8d-2961-461f-a67c-6fd45b0bbe01" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[711849d8-0802-498e-ac04-7bcef7c0a10c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:21 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 Sep 25 16:25:21 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:21 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:21 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01 Sep 25 16:25:21 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:21 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b1441f8d-2961-461f-a67c-6fd45b0bbe01" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-b1441f8d-2961-461f-a67c-6fd45b0bbe01" released by "delete_volume" :: held 0.691s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Created reservations ['227498f1-6362-47bb-baa0-9434d4bd1fab', '031e2932-e925-4bd7-98eb-10b0aaa7cd00', '31ab403e-6bc9-43d7-9614-013d1c40ebba', '5ee471eb-0f15-413e-8a07-01a9181b35d8'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:21 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:21 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:22 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.236s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Deleted volume successfully. Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-afc9435c-bc3f-46c6-80b8-a45ce388e339 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-b1441f8d-2961-461f-a67c-6fd45b0bbe01-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-quobyte-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0a10f2-4d31-413d-b286-76315e31f8dc]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:22 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e Sep 25 16:25:22 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:22 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e" returned: 0 in 0.356s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:22 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e Sep 25 16:25:22 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:22 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e" released by "delete_volume" :: held 0.654s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:22 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Created reservations ['c061461c-17db-45df-9890-0af2b1253666', '997adbbb-738e-41c0-b684-7f43c06cfeca', '9c635356-7205-4861-b94d-361a22055178', '35432f21-e943-4e92-a30a-16aad0cb4b06'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:23 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:23 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:23 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Deleted volume successfully. Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-69a5f728-9bde-49c3-bdca-9a03d214739e tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-1192f402-dee1-43e3-b1d1-9b7dd8eb5f9e-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-6b2a0856-ec06-4d85-9c12-5c27da0a1fae-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-6b2a0856-ec06-4d85-9c12-5c27da0a1fae-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "cinder-quobyte-6b2a0856-ec06-4d85-9c12-5c27da0a1fae" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-6b2a0856-ec06-4d85-9c12-5c27da0a1fae" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ee811d-86e4-4d30-8715-aca62100d4ae]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:23 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae Sep 25 16:25:23 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:23 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae" returned: 0 in 0.376s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:23 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae Sep 25 16:25:23 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:24 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6b2a0856-ec06-4d85-9c12-5c27da0a1fae" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-quobyte-6b2a0856-ec06-4d85-9c12-5c27da0a1fae" released by "delete_volume" :: held 0.699s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Created reservations ['731cecdd-015b-49d4-83b2-c0e2281ff70e', '184ad88c-28bc-464e-a448-19128584a202', 'ba3bccf4-f8d8-4895-b1b4-883493b428aa', '316faac4-9741-4fed-97fc-a5b3e88b9e62'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:24 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:24 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:24 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Deleted volume successfully. Sep 25 16:25:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0597d2da-e692-46c3-adc4-13a5b10c9f38 tempest-CreateVolumesFromImageTest-1611120245 None] Lock "cinder-6b2a0856-ec06-4d85-9c12-5c27da0a1fae-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (9e3be14f-6468-4a11-8c94-14955c99243e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5237a211-ee02-4a30-979e-2bde1ed7d0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5237a211-ee02-4a30-979e-2bde1ed7d0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219391565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ae7db3-cef2-4346-8e17-1b25f601486f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:28Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958e0e66-df2a-4d59-a81d-1af65cf04aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958e0e66-df2a-4d59-a81d-1af65cf04aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e69c61-5d5e-4dd2-89f0-e2a39981588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e69c61-5d5e-4dd2-89f0-e2a39981588a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ae7db3-cef2-4346-8e17-1b25f601486f', 'volume_name': 'volume-e3ae7db3-cef2-4346-8e17-1b25f601486f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee8787f-66dd-4eb3-9890-05ed39615d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee8787f-66dd-4eb3-9890-05ed39615d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5738690c-3de3-4f9a-93e4-0c91d6375d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume e3ae7db3-cef2-4346-8e17-1b25f601486f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ae7db3-cef2-4346-8e17-1b25f601486f', 'volume_size': 1} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219391565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ae7db3-cef2-4346-8e17-1b25f601486f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:28Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Creating volume e3ae7db3-cef2-4346-8e17-1b25f601486f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:28 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:28 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f 1073741824 Sep 25 16:25:28 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:28 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f 1073741824" returned: 0 in 0.502s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:28 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f Sep 25 16:25:28 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:28 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5738690c-3de3-4f9a-93e4-0c91d6375d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ae7db3-cef2-4346-8e17-1b25f601486f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b99f2d-7d92-4f87-a084-42ef693c6952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume volume-e3ae7db3-cef2-4346-8e17-1b25f601486f (e3ae7db3-cef2-4346-8e17-1b25f601486f): created successfully Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b99f2d-7d92-4f87-a084-42ef693c6952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (9e3be14f-6468-4a11-8c94-14955c99243e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-152120b4-b69c-4d2f-a05b-ae503a3449d7 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created volume successfully. Sep 25 16:25:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Creating offline snapshot 83692f10-14cc-4c05-861e-d50c18a254c0 of volume e3ae7db3-cef2-4346-8e17-1b25f601486f {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:25:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7064f270-4c68-4a96-a874-b0ea08783d72]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:30 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f Sep 25 16:25:30 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:30 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:30 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 1G Sep 25 16:25:30 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:31 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 1G" returned: 0 in 0.421s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ae7db3-cef2-4346-8e17-1b25f601486f -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:31 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ae7db3-cef2-4346-8e17-1b25f601486f -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 Sep 25 16:25:31 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:31 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ae7db3-cef2-4346-8e17-1b25f601486f -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:31 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 is being set with open permissions: ugo+rw Sep 25 16:25:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:31 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 Sep 25 16:25:31 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:31 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0" returned: 0 in 0.244s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:31 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.info Sep 25 16:25:31 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:32 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.info" returned: 0 in 0.273s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:32 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.info is being set with open permissions: ugo+rw Sep 25 16:25:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:32 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.info Sep 25 16:25:32 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:32 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.info" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-36334f1c-eeed-4363-a3a1-2a34e1ffdc76 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Create snapshot completed successfully Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (4b31daf1-b16d-4752-96ed-b1fbdac291ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d194ee-5568-4b00-a132-bc08171675ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d194ee-5568-4b00-a132-bc08171675ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1206455376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:33Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171cadd9-0ab4-4a8a-a852-0a305ed3214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171cadd9-0ab4-4a8a-a852-0a305ed3214b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2806f1-b245-4e7e-99b5-40169862b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2806f1-b245-4e7e-99b5-40169862b321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2', 'volume_name': 'volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfc06c5-6a2b-44e1-b41c-0de3d55ea472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfc06c5-6a2b-44e1-b41c-0de3d55ea472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8221d3f-9d84-4737-bed1-22f6b7f3ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume 1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2', 'volume_size': 1} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1206455376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:33Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Creating volume 1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:33 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:33 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 1073741824 Sep 25 16:25:33 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (a0f9655c-de9e-47e6-805d-7f8374dda28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f60eae7-49ce-45fb-85ac-f33060b2caa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f60eae7-49ce-45fb-85ac-f33060b2caa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1160928786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46da3506-d8de-4c62-9d78-9f22f417df62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:33Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d25b8a5-e3b8-445d-b72f-35fdc59efb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d25b8a5-e3b8-445d-b72f-35fdc59efb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46166058-d004-4d07-8b5f-1d97104b34d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46166058-d004-4d07-8b5f-1d97104b34d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46da3506-d8de-4c62-9d78-9f22f417df62', 'volume_name': 'volume-46da3506-d8de-4c62-9d78-9f22f417df62', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6b9d68-0ce2-4ead-bae4-e53fe5a9acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6b9d68-0ce2-4ead-bae4-e53fe5a9acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec2f92a-fb1d-443a-bc1f-3e7a9eaaeef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume 46da3506-d8de-4c62-9d78-9f22f417df62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46da3506-d8de-4c62-9d78-9f22f417df62', 'volume_size': 1} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:33 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 1073741824" returned: 0 in 0.549s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:33 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 Sep 25 16:25:33 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (4dc76218-5156-4a94-a4dc-0baf3e95c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6620d2-5757-40fb-bdf1-39f954d64a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6620d2-5757-40fb-bdf1-39f954d64a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-720834325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e58001a-1195-4fa2-bb99-2b1c98e2ea0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:34Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500c3c62-ca7b-4bad-a0d9-ed15bba39bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500c3c62-ca7b-4bad-a0d9-ed15bba39bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4520499b-8344-4f82-8eca-2f6f3bc7940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4520499b-8344-4f82-8eca-2f6f3bc7940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e58001a-1195-4fa2-bb99-2b1c98e2ea0b', 'volume_name': 'volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48277a21-1bf2-493b-aef1-97dab3ac0a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48277a21-1bf2-493b-aef1-97dab3ac0a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdd36df-5c5c-4bd9-b105-07e25aae764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume 8e58001a-1195-4fa2-bb99-2b1c98e2ea0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b', 'volume_size': 1} Sep 25 16:25:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:34 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2" returned: 0 in 0.338s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1160928786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46da3506-d8de-4c62-9d78-9f22f417df62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:33Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Creating volume 46da3506-d8de-4c62-9d78-9f22f417df62 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:34 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:34 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62 1073741824 Sep 25 16:25:34 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8221d3f-9d84-4737-bed1-22f6b7f3ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc99629-e9ae-4772-98f2-9761e938b59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 (1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2): created successfully Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc99629-e9ae-4772-98f2-9761e938b59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (4b31daf1-b16d-4752-96ed-b1fbdac291ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6c6b9c8f-88e9-4fa3-8b28-57d4ff98aa6a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created volume successfully. Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (baa63fb3-9201-45fe-a464-1757ad0a7305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a058bbdc-9db6-4d44-b687-57278a872fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a058bbdc-9db6-4d44-b687-57278a872fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2035998744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f57039-b75e-4e1d-895b-d1883b6fa289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:34Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab74a0f1-4ed9-4336-a221-286e86f406ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab74a0f1-4ed9-4336-a221-286e86f406ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd98ad7d-d465-43d0-863b-b5cb825cd716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd98ad7d-d465-43d0-863b-b5cb825cd716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f57039-b75e-4e1d-895b-d1883b6fa289', 'volume_name': 'volume-a0f57039-b75e-4e1d-895b-d1883b6fa289', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8573e718-5f26-4a86-b393-814d94cc64c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8573e718-5f26-4a86-b393-814d94cc64c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43541801-e9b0-4ff3-8bff-52bb94464f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume a0f57039-b75e-4e1d-895b-d1883b6fa289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f57039-b75e-4e1d-895b-d1883b6fa289', 'volume_size': 1} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:34 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62 1073741824" returned: 0 in 0.597s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:34 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62 Sep 25 16:25:34 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (06db0054-b163-414b-bfd0-babc3812c607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d82ef55-e6f3-4822-9b17-ce5b3f444f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d82ef55-e6f3-4822-9b17-ce5b3f444f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-777264740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e467dad-136d-43a2-af0e-d625bedc5de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:35Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd51870-a6ce-4814-9049-b50a4c56850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd51870-a6ce-4814-9049-b50a4c56850a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1328734e-0f8c-49ed-b28b-1496068d37c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1328734e-0f8c-49ed-b28b-1496068d37c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e467dad-136d-43a2-af0e-d625bedc5de2', 'volume_name': 'volume-5e467dad-136d-43a2-af0e-d625bedc5de2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62268b0b-3fa1-4d92-9110-85343fe86e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62268b0b-3fa1-4d92-9110-85343fe86e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676162d5-fc7d-4075-aac0-ccfd317ec7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume 5e467dad-136d-43a2-af0e-d625bedc5de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e467dad-136d-43a2-af0e-d625bedc5de2', 'volume_size': 1} Sep 25 16:25:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:35 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62" returned: 0 in 0.285s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-720834325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e58001a-1195-4fa2-bb99-2b1c98e2ea0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:34Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Creating volume 8e58001a-1195-4fa2-bb99-2b1c98e2ea0b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:35 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec2f92a-fb1d-443a-bc1f-3e7a9eaaeef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46da3506-d8de-4c62-9d78-9f22f417df62', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cc8e33-790a-4f95-b1aa-c7f2e72c2e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:35 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b 1073741824 Sep 25 16:25:35 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume volume-46da3506-d8de-4c62-9d78-9f22f417df62 (46da3506-d8de-4c62-9d78-9f22f417df62): created successfully Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cc8e33-790a-4f95-b1aa-c7f2e72c2e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (a0f9655c-de9e-47e6-805d-7f8374dda28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-04a33a82-88bf-4e3f-bbd8-1066fbc1eb2a tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created volume successfully. Sep 25 16:25:35 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b 1073741824" returned: 0 in 0.480s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:35 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b Sep 25 16:25:35 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:35 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b" returned: 0 in 0.311s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2035998744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f57039-b75e-4e1d-895b-d1883b6fa289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:34Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Creating volume a0f57039-b75e-4e1d-895b-d1883b6fa289 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:35 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdd36df-5c5c-4bd9-b105-07e25aae764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92007a67-a337-4c50-b7d1-73981ed68b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:35 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 1073741824 Sep 25 16:25:35 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b (8e58001a-1195-4fa2-bb99-2b1c98e2ea0b): created successfully Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92007a67-a337-4c50-b7d1-73981ed68b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (4dc76218-5156-4a94-a4dc-0baf3e95c719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8295aa01-c883-42a7-9616-58197a6b9d0f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created volume successfully. Sep 25 16:25:36 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 1073741824" returned: 0 in 0.468s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:36 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 Sep 25 16:25:36 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:36 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289" returned: 0 in 0.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.735s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-777264740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e467dad-136d-43a2-af0e-d625bedc5de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c9fcf1e2134744ac45e25bb3d5baf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:35Z,use_quota=True,user_id='5df467dcc9674227bf8145799017f413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Creating volume 5e467dad-136d-43a2-af0e-d625bedc5de2 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:36 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2 1073741824 Sep 25 16:25:36 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43541801-e9b0-4ff3-8bff-52bb94464f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f57039-b75e-4e1d-895b-d1883b6fa289', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db8ddce-610b-44ff-aff2-11ec6e217ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 (a0f57039-b75e-4e1d-895b-d1883b6fa289): created successfully Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db8ddce-610b-44ff-aff2-11ec6e217ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (baa63fb3-9201-45fe-a464-1757ad0a7305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-711ee08e-1587-443d-822d-e3cf616edce6 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created volume successfully. Sep 25 16:25:37 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2 1073741824" returned: 0 in 0.496s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:37 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2 Sep 25 16:25:37 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:37 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676162d5-fc7d-4075-aac0-ccfd317ec7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e467dad-136d-43a2-af0e-d625bedc5de2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb2c597-bff7-4112-a4ef-77a69b94aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Volume volume-5e467dad-136d-43a2-af0e-d625bedc5de2 (5e467dad-136d-43a2-af0e-d625bedc5de2): created successfully Sep 25 16:25:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb2c597-bff7-4112-a4ef-77a69b94aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Flow 'volume_create_manager' (06db0054-b163-414b-bfd0-babc3812c607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ca6c21df-2c63-444a-8471-8ce68a0e407f tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created volume successfully. Sep 25 16:25:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-5e467dad-136d-43a2-af0e-d625bedc5de2-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-5e467dad-136d-43a2-af0e-d625bedc5de2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-quobyte-5e467dad-136d-43a2-af0e-d625bedc5de2" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-5e467dad-136d-43a2-af0e-d625bedc5de2" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb96531-4f43-4e0d-836c-4002ca42d789]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:38 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2 Sep 25 16:25:38 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:38 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:38 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2 Sep 25 16:25:38 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:39 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-5e467dad-136d-43a2-af0e-d625bedc5de2" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-5e467dad-136d-43a2-af0e-d625bedc5de2" released by "delete_volume" :: held 0.730s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created reservations ['7cd90d01-77fd-431e-820e-c06207d3faed', '7240aa0c-e1a2-4583-98b1-1b20513ea946', 'e285caa8-8bad-40e4-9fc7-8d7d1aadccef', '5368503b-2c0c-47c2-aaa2-9dcc8cbc6b78'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:39 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:39 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-a0f57039-b75e-4e1d-895b-d1883b6fa289-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-a0f57039-b75e-4e1d-895b-d1883b6fa289-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:39 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.321s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-quobyte-a0f57039-b75e-4e1d-895b-d1883b6fa289" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Deleted volume successfully. Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-a0f57039-b75e-4e1d-895b-d1883b6fa289" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cad5d028-c411-46a7-99e4-7f9efbd75104 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-5e467dad-136d-43a2-af0e-d625bedc5de2-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[23366743-5524-4668-869d-28b3030a0edf]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:39 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 Sep 25 16:25:39 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:40 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289" returned: 0 in 0.407s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:40 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289 Sep 25 16:25:40 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:40 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-a0f57039-b75e-4e1d-895b-d1883b6fa289" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-a0f57039-b75e-4e1d-895b-d1883b6fa289" released by "delete_volume" :: held 0.720s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created reservations ['394210f5-db36-4a5c-9057-141beadc18e4', 'a52adcfa-cb8e-499e-b554-b5d63d76207b', '343bee3a-25c3-4ea3-8604-f612228815bb', '16315764-6bc9-47e7-ba2e-b41f06035ea2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:40 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:40 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:40 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-quobyte-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Deleted volume successfully. Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e609ce4b-7368-44c8-afc8-c6aa08e18cf9]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cfab94e4-ac2b-4640-9560-2fd27e214a7d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-a0f57039-b75e-4e1d-895b-d1883b6fa289-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:40 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b Sep 25 16:25:40 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:41 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b" returned: 0 in 0.474s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:41 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b Sep 25 16:25:41 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:41 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b" returned: 0 in 0.304s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b" released by "delete_volume" :: held 0.831s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created reservations ['34035cbf-81f5-48b7-9b9c-f2585c2e83f8', '4493ff93-2225-4b2f-8571-33d53a920ada', '95146d62-2845-4d1e-8453-f5eb0b08297c', '7ad7b225-13ca-4ff2-98fc-ca9682c4296a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:41 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:41 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-46da3506-d8de-4c62-9d78-9f22f417df62-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-46da3506-d8de-4c62-9d78-9f22f417df62-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-quobyte-46da3506-d8de-4c62-9d78-9f22f417df62" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-46da3506-d8de-4c62-9d78-9f22f417df62" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ff3a72-f97f-464d-8b40-983cb76b9b3b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:42 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.337s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Deleted volume successfully. Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c15d046b-d3d9-46ec-9ef7-2e39ddd0497c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-8e58001a-1195-4fa2-bb99-2b1c98e2ea0b-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:42 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62 Sep 25 16:25:42 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:42 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62" returned: 0 in 0.476s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:42 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62 Sep 25 16:25:42 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:42 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-46da3506-d8de-4c62-9d78-9f22f417df62" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-46da3506-d8de-4c62-9d78-9f22f417df62" released by "delete_volume" :: held 0.807s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created reservations ['c52130ce-3ad5-43dd-a772-70f42421ec2b', '4ffc4734-130b-4592-b14a-5162b570ca87', '3a830fdf-dc97-4908-a25a-06c681d7bb0f', '1e0df44f-9003-44b8-a073-f139ef13737a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:42 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:42 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-quobyte-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:43 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa46f667-5a66-4441-87ed-a585f1504173]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Deleted volume successfully. Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a575c1f5-eee0-476f-b6fb-22be3214356c tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-46da3506-d8de-4c62-9d78-9f22f417df62-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:43 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 Sep 25 16:25:43 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:43 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2" returned: 0 in 0.456s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:43 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2 Sep 25 16:25:43 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:44 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2" released by "delete_volume" :: held 0.821s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created reservations ['23749e25-92a7-4ffa-b444-19003a0199f6', 'c5c36f75-9f9d-4906-84d4-754eec7ed790', '2de8d31e-4845-44ea-b409-f104dc765e14', '024f4d11-7d31-49bc-8f05-14fa0ce956cb'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:44 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:44 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:44 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Deleted volume successfully. Sep 25 16:25:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1909cea0-ff20-4bfd-8c81-7029f23fa085 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-1d5bcea8-2952-4f76-8ac2-d8ba4adc84f2-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-83692f10-14cc-4c05-861e-d50c18a254c0-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-83692f10-14cc-4c05-861e-d50c18a254c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-quobyte-e3ae7db3-cef2-4346-8e17-1b25f601486f" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-e3ae7db3-cef2-4346-8e17-1b25f601486f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-quobyte-83692f10-14cc-4c05-861e-d50c18a254c0" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-83692f10-14cc-4c05-861e-d50c18a254c0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Deleting offline snapshot 83692f10-14cc-4c05-861e-d50c18a254c0 of volume e3ae7db3-cef2-4346-8e17-1b25f601486f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] snapshot_file for this snap is: volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b80c5e4-4e52-48f3-949c-aa4c64dcabfe]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:45 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 Sep 25 16:25:45 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:45 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0" returned: 0 in 0.409s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ae7db3-cef2-4346-8e17-1b25f601486f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fbfa2d-942a-467a-97e5-0228fc453f78]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:46 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f Sep 25 16:25:46 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:46 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f" returned: 0 in 0.432s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:46 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 Sep 25 16:25:46 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:46 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:46 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0 Sep 25 16:25:46 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:47 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f.83692f10-14cc-4c05-861e-d50c18a254c0" returned: 0 in 0.283s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-83692f10-14cc-4c05-861e-d50c18a254c0" released by "_delete_snapshot" :: held 1.644s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-e3ae7db3-cef2-4346-8e17-1b25f601486f" released by "delete_snapshot" :: held 1.670s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created reservations ['374315a1-6c8e-4a33-9ab2-48c5ed7f9968', 'dcd0b338-2b6c-41c8-aeaf-24a64c843c05', '242bef1a-820e-473a-ab0c-88e926c97142', '7a165135-2b36-4ac0-ba34-ec96f0cf184f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Delete snapshot completed successfully. Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea948f15-845c-405a-a685-7593c2b6e470 tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-83692f10-14cc-4c05-861e-d50c18a254c0-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-e3ae7db3-cef2-4346-8e17-1b25f601486f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-e3ae7db3-cef2-4346-8e17-1b25f601486f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "cinder-quobyte-e3ae7db3-cef2-4346-8e17-1b25f601486f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-e3ae7db3-cef2-4346-8e17-1b25f601486f" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[be251603-7939-4fc7-9f01-8d369a51829d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:47 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f Sep 25 16:25:47 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:48 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:48 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f Sep 25 16:25:48 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:48 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e3ae7db3-cef2-4346-8e17-1b25f601486f" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-quobyte-e3ae7db3-cef2-4346-8e17-1b25f601486f" released by "delete_volume" :: held 0.757s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Created reservations ['f8accdd6-b028-414d-87f8-9acf9b20b01b', '637f0b3c-6ed1-4c75-b17d-5547a104eb82', 'd33b7916-78e6-4c8d-9319-7253644ebcda', 'ca2df98b-50f6-4a9c-8904-c7507840c262'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:48 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:48 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:48 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.320s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Deleted volume successfully. Sep 25 16:25:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f361ab6a-bdae-4e73-9af6-bc191a2ebc0d tempest-CreateVolumesFromSnapshotTest-2098129306 None] Lock "cinder-e3ae7db3-cef2-4346-8e17-1b25f601486f-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Flow 'volume_create_manager' (7bd69239-19d1-4848-b4af-0ae0b9ba28b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63c3138-87af-4e52-97c8-e1f56bbd5d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63c3138-87af-4e52-97c8-e1f56bbd5d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9e5121-fe75-4af1-ad9f-15bfc5156fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb539f2e35840069fb24a2142c368e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:52Z,use_quota=True,user_id='c137632f4f494154a538e8e266506fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026f0e8e-322f-4209-82ab-70c28b4d68f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026f0e8e-322f-4209-82ab-70c28b4d68f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3ae81b-8376-4ced-84ff-3bbc36f7a43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3ae81b-8376-4ced-84ff-3bbc36f7a43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c9e5121-fe75-4af1-ad9f-15bfc5156fec', 'volume_name': 'volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d7334c-3247-4ecf-aaf7-67f11b258324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d7334c-3247-4ecf-aaf7-67f11b258324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7773cd0-9ae8-4c6a-aa95-7607e341a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:51 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Volume 1c9e5121-fe75-4af1-ad9f-15bfc5156fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec', 'volume_size': 1} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9e5121-fe75-4af1-ad9f-15bfc5156fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb539f2e35840069fb24a2142c368e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:52Z,use_quota=True,user_id='c137632f4f494154a538e8e266506fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Creating volume 1c9e5121-fe75-4af1-ad9f-15bfc5156fec {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:51 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:51 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec 1073741824 Sep 25 16:25:51 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:52 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec 1073741824" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:52 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec Sep 25 16:25:52 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:52 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec" returned: 0 in 0.275s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7773cd0-9ae8-4c6a-aa95-7607e341a815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e9a075-c128-4308-9f36-dad8f045ca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Volume volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec (1c9e5121-fe75-4af1-ad9f-15bfc5156fec): created successfully Sep 25 16:25:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e9a075-c128-4308-9f36-dad8f045ca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Flow 'volume_create_manager' (7bd69239-19d1-4848-b4af-0ae0b9ba28b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-eed75131-7d30-4916-a6c9-f15fc5c8cb03 tempest-CinderUnicodeTest-314638033 None] Created volume successfully. Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Flow 'volume_create_manager' (efb6712a-db53-4d71-83db-0dd54be972ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a1a7f6-42be-4159-a093-f95b973575ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a1a7f6-42be-4159-a093-f95b973575ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-824569242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d8c5cd0-95eb-46ca-9611-50db5eba35fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb539f2e35840069fb24a2142c368e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:53Z,use_quota=True,user_id='c137632f4f494154a538e8e266506fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063ef07d-8311-47a6-80aa-674d079c1903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063ef07d-8311-47a6-80aa-674d079c1903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb264b9-b2e4-4268-8a6d-450e377e710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb264b9-b2e4-4268-8a6d-450e377e710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d8c5cd0-95eb-46ca-9611-50db5eba35fd', 'volume_name': 'volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f95dc5-80c7-44ce-97c9-5a36b25864f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f95dc5-80c7-44ce-97c9-5a36b25864f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2123d638-a701-4b2d-b37a-ac8341a81c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:53 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Volume 6d8c5cd0-95eb-46ca-9611-50db5eba35fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd', 'volume_size': 1} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-824569242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d8c5cd0-95eb-46ca-9611-50db5eba35fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb539f2e35840069fb24a2142c368e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:53Z,use_quota=True,user_id='c137632f4f494154a538e8e266506fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Creating volume 6d8c5cd0-95eb-46ca-9611-50db5eba35fd {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:53 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:53 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd 1073741824 Sep 25 16:25:53 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:53 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd 1073741824" returned: 0 in 0.464s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:53 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd Sep 25 16:25:53 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:54 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2123d638-a701-4b2d-b37a-ac8341a81c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d289f55-e6f6-4409-928f-6e7f4d33edfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Volume volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd (6d8c5cd0-95eb-46ca-9611-50db5eba35fd): created successfully Sep 25 16:25:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d289f55-e6f6-4409-928f-6e7f4d33edfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Flow 'volume_create_manager' (efb6712a-db53-4d71-83db-0dd54be972ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e0c933d0-5a17-4c52-a492-c282f6bd53fe tempest-CinderUnicodeTest-314638033 None] Created volume successfully. Sep 25 16:25:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Creating offline snapshot 78b77862-816b-4d30-8518-6ac349288c54 of volume 6d8c5cd0-95eb-46ca-9611-50db5eba35fd {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:25:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[043a0acd-f1cb-4d7f-af3f-9a8a55e2056f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:55 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd Sep 25 16:25:55 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:56 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" returned: 0 in 0.361s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:56 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 1G Sep 25 16:25:56 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:56 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 1G" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:56 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 Sep 25 16:25:56 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:56 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:56 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 is being set with open permissions: ugo+rw Sep 25 16:25:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:56 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 Sep 25 16:25:56 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:57 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:57 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.info Sep 25 16:25:57 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:57 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.info" returned: 0 in 0.275s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:57 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.info is being set with open permissions: ugo+rw Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:57 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.info Sep 25 16:25:57 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:57 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.info" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-993271a4-b412-4f6a-b36b-4a9aa99afaf4 tempest-CinderUnicodeTest-314638033 None] Create snapshot completed successfully Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Acquiring lock "cinder-78b77862-816b-4d30-8518-6ac349288c54-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-78b77862-816b-4d30-8518-6ac349288c54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Acquiring lock "cinder-quobyte-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-quobyte-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Acquiring lock "cinder-quobyte-78b77862-816b-4d30-8518-6ac349288c54" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-quobyte-78b77862-816b-4d30-8518-6ac349288c54" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Deleting offline snapshot 78b77862-816b-4d30-8518-6ac349288c54 of volume 6d8c5cd0-95eb-46ca-9611-50db5eba35fd {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] snapshot_file for this snap is: volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aa81f7-a157-442e-8456-7ebc1202ca05]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:58 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 Sep 25 16:25:58 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:58 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a39359-c21d-4427-b8b6-c9ca619fbf68]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:58 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd Sep 25 16:25:58 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:58 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:25:58 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:58 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" returned: 0 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:58 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 Sep 25 16:25:58 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:58 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:25:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:25:59 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54" returned: 0 in 0.349s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:59 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54 Sep 25 16:25:59 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:59 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd.78b77862-816b-4d30-8518-6ac349288c54" returned: 0 in 0.240s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-quobyte-78b77862-816b-4d30-8518-6ac349288c54" released by "_delete_snapshot" :: held 1.426s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-quobyte-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" released by "delete_snapshot" :: held 1.457s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Created reservations ['89e2cac3-c7f9-4295-8f35-f49453f5d305', '5b8f198b-abcd-4129-ad3a-7f1bb4e926cc', '32949c81-d6fc-4528-9e8b-21dd618210a4', '027c127b-39a8-4b0b-a384-57c3214e5aee'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Delete snapshot completed successfully. Sep 25 16:25:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7627184-4f78-4b03-aefb-64aa4ab13083 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-78b77862-816b-4d30-8518-6ac349288c54-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Acquiring lock "cinder-6d8c5cd0-95eb-46ca-9611-50db5eba35fd-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-6d8c5cd0-95eb-46ca-9611-50db5eba35fd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Acquiring lock "cinder-quobyte-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-quobyte-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8e8d46-2c46-41f1-a0b8-5f3f8a12c38b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:00 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd Sep 25 16:26:00 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:00 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:00 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd Sep 25 16:26:00 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:00 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-quobyte-6d8c5cd0-95eb-46ca-9611-50db5eba35fd" released by "delete_volume" :: held 0.692s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Created reservations ['462e6c5e-2668-48f7-bd19-11daabbbc00a', 'e28c835f-9ffd-4972-b6dc-791f7e7eca3e', '98fb1aff-7bea-45b5-81b8-2deba37ed44e', '4b365d1e-d856-436a-9d97-515446ffdd91'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:00 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:00 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:01 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Deleted volume successfully. Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Acquiring lock "cinder-1c9e5121-fe75-4af1-ad9f-15bfc5156fec-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-adf7af11-fdca-4033-9649-425c259f96f0 tempest-CinderUnicodeTest-314638033 None] Lock "cinder-6d8c5cd0-95eb-46ca-9611-50db5eba35fd-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Lock "cinder-1c9e5121-fe75-4af1-ad9f-15bfc5156fec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Acquiring lock "cinder-quobyte-1c9e5121-fe75-4af1-ad9f-15bfc5156fec" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Lock "cinder-quobyte-1c9e5121-fe75-4af1-ad9f-15bfc5156fec" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2a38f8-6468-4284-a9d7-e8cd556d2f3c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:01 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec Sep 25 16:26:01 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:01 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec" returned: 0 in 0.360s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:01 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec Sep 25 16:26:01 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:01 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-1c9e5121-fe75-4af1-ad9f-15bfc5156fec" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Lock "cinder-quobyte-1c9e5121-fe75-4af1-ad9f-15bfc5156fec" released by "delete_volume" :: held 0.660s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Created reservations ['956fabab-aea9-4566-9de9-67fdbdfb667f', 'd718c927-6207-44df-8c61-3941becd4d06', '849a30c7-b100-4f0f-a745-c63f69e1d203', 'a485e62c-e472-4be8-8b03-ee1ca301aaf4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:02 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:02 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:02 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.273s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Deleted volume successfully. Sep 25 16:26:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d4666773-333e-4b85-954e-ff1353ba2e1d tempest-CinderUnicodeTest-314638033 None] Lock "cinder-1c9e5121-fe75-4af1-ad9f-15bfc5156fec-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:05 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Flow 'volume_create_manager' (2eb3d4b8-7461-4732-a93c-c89e5951ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fef37f-328c-4b3c-8759-302b3dd2afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fef37f-328c-4b3c-8759-302b3dd2afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970543621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537739f3-405c-4440-8ad9-903f4acf8587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cb1034114943fd93de54e3dab5c3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:06Z,use_quota=True,user_id='e75aaf4a48bb434584a9a8f84a20bd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf1a44a-9c4a-43fd-bdfb-90f9fcab5b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf1a44a-9c4a-43fd-bdfb-90f9fcab5b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f86e899-1ea2-4aa0-8f2a-f67997fd89a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f86e899-1ea2-4aa0-8f2a-f67997fd89a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537739f3-405c-4440-8ad9-903f4acf8587', 'volume_name': 'volume-537739f3-405c-4440-8ad9-903f4acf8587', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7094c5-c3ca-4923-8226-286cae3a6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7094c5-c3ca-4923-8226-286cae3a6992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5a6acb-3315-4a3a-9080-194e769ee347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Volume 537739f3-405c-4440-8ad9-903f4acf8587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537739f3-405c-4440-8ad9-903f4acf8587', 'volume_size': 1} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970543621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537739f3-405c-4440-8ad9-903f4acf8587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cb1034114943fd93de54e3dab5c3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:06Z,use_quota=True,user_id='e75aaf4a48bb434584a9a8f84a20bd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Creating volume 537739f3-405c-4440-8ad9-903f4acf8587 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:06 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:06 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587 1073741824 Sep 25 16:26:06 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:06 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587 1073741824" returned: 0 in 0.497s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=164,cinder:SELECT=107,cinder:DELETE=14,cinder:INSERT=37 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:06 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587 Sep 25 16:26:06 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:06 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5a6acb-3315-4a3a-9080-194e769ee347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537739f3-405c-4440-8ad9-903f4acf8587', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6d55a0-81f1-48e9-8368-841655d3086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Volume volume-537739f3-405c-4440-8ad9-903f4acf8587 (537739f3-405c-4440-8ad9-903f4acf8587): created successfully Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6d55a0-81f1-48e9-8368-841655d3086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Flow 'volume_create_manager' (2eb3d4b8-7461-4732-a93c-c89e5951ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-05d4383c-260b-48de-8b05-82eef304eb49 tempest-ProjectReaderTests-2111997362 None] Created volume successfully. Sep 25 16:26:06 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=115,cinder:UPDATE=154,cinder:INSERT=39,cinder:DELETE=15 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:26:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "cinder-537739f3-405c-4440-8ad9-903f4acf8587-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Lock "cinder-537739f3-405c-4440-8ad9-903f4acf8587-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "cinder-quobyte-537739f3-405c-4440-8ad9-903f4acf8587" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Lock "cinder-quobyte-537739f3-405c-4440-8ad9-903f4acf8587" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda43be5-4e9c-4784-9b38-9e1a969af09a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:08 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587 Sep 25 16:26:08 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:08 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587" returned: 0 in 0.407s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:08 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587 Sep 25 16:26:08 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:09 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-537739f3-405c-4440-8ad9-903f4acf8587" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Lock "cinder-quobyte-537739f3-405c-4440-8ad9-903f4acf8587" released by "delete_volume" :: held 0.744s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Created reservations ['0648d031-711a-4e51-946c-618a6a388cd0', '50f69055-773f-49c8-b760-9d846c30d30d', '6fb59e9b-54ca-43f7-a1f2-486e4edef2b3', '8d7f63e7-06c8-4502-b717-4a00229cee17'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:09 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:09 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:09 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Deleted volume successfully. Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bc0a4662-7800-405b-bcdd-cae421ec1150 tempest-ProjectReaderTests-2111997362 None] Lock "cinder-537739f3-405c-4440-8ad9-903f4acf8587-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Flow 'volume_create_manager' (08aa0871-d5b6-49bd-bab8-04cd8325535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c2756e-e686-48f0-a606-c231cb667792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c2756e-e686-48f0-a606-c231cb667792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220228785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e27663-cb96-46fe-b993-ffd8a0b758c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cb1034114943fd93de54e3dab5c3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:10Z,use_quota=True,user_id='e75aaf4a48bb434584a9a8f84a20bd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2516cbbd-a67b-46cc-8802-bf37e71275c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2516cbbd-a67b-46cc-8802-bf37e71275c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7c8c49-55cb-4f74-97ff-5a8cd0f53948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7c8c49-55cb-4f74-97ff-5a8cd0f53948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e27663-cb96-46fe-b993-ffd8a0b758c6', 'volume_name': 'volume-25e27663-cb96-46fe-b993-ffd8a0b758c6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58efcf0c-c79c-4267-8651-b454e601d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58efcf0c-c79c-4267-8651-b454e601d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ddd83a-4dd3-4131-b847-4e5d12831883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:10 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Volume 25e27663-cb96-46fe-b993-ffd8a0b758c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e27663-cb96-46fe-b993-ffd8a0b758c6', 'volume_size': 1} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220228785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e27663-cb96-46fe-b993-ffd8a0b758c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cb1034114943fd93de54e3dab5c3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:10Z,use_quota=True,user_id='e75aaf4a48bb434584a9a8f84a20bd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Creating volume 25e27663-cb96-46fe-b993-ffd8a0b758c6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:10 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:10 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 1073741824 Sep 25 16:26:10 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:10 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 1073741824" returned: 0 in 0.473s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:10 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 Sep 25 16:26:10 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:10 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6" returned: 0 in 0.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ddd83a-4dd3-4131-b847-4e5d12831883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e27663-cb96-46fe-b993-ffd8a0b758c6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754e952c-75da-452e-822d-8903058a9587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:10 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Volume volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 (25e27663-cb96-46fe-b993-ffd8a0b758c6): created successfully Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754e952c-75da-452e-822d-8903058a9587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Flow 'volume_create_manager' (08aa0871-d5b6-49bd-bab8-04cd8325535f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-734f416e-f9c0-46e5-91e2-7b9b9ecd1237 tempest-ProjectReaderTests-2111997362 None] Created volume successfully. Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "cinder-25e27663-cb96-46fe-b993-ffd8a0b758c6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Lock "cinder-25e27663-cb96-46fe-b993-ffd8a0b758c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "cinder-quobyte-25e27663-cb96-46fe-b993-ffd8a0b758c6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Lock "cinder-quobyte-25e27663-cb96-46fe-b993-ffd8a0b758c6" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff10f42-9f5a-42cd-97f3-2a96020b8fa6]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:12 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 Sep 25 16:26:12 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:12 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6" returned: 0 in 0.375s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:12 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6 Sep 25 16:26:12 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:12 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-25e27663-cb96-46fe-b993-ffd8a0b758c6" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Lock "cinder-quobyte-25e27663-cb96-46fe-b993-ffd8a0b758c6" released by "delete_volume" :: held 0.678s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Created reservations ['a027e1c0-faf3-402e-96dd-022e04120343', '87574def-b460-4e66-82a4-b1203ee327c1', 'a5b78bb7-8fc7-4015-bf54-d2b1740b6a03', 'd940e8c0-b806-4e3c-bad4-2b0f86be6d4f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:12 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:12 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:13 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:13 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Deleted volume successfully. Sep 25 16:26:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3db84e26-5952-4ea6-a4ea-45a6d9d980f8 tempest-ProjectReaderTests-2111997362 None] Lock "cinder-25e27663-cb96-46fe-b993-ffd8a0b758c6-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:22 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:26:23 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=21,cinder:SELECT=10,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (38adcd66-a303-43ca-bf7f-4a746193cff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879e03a0-51e8-4c55-9677-9073c9ab03b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879e03a0-51e8-4c55-9677-9073c9ab03b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930994373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98b11be-a383-4306-90e7-0dda1bed9ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:35Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436eaa36-a163-43b3-93b1-f2fd0e7050b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436eaa36-a163-43b3-93b1-f2fd0e7050b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c7b36e-ae35-420f-a12b-8aa15745407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c7b36e-ae35-420f-a12b-8aa15745407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98b11be-a383-4306-90e7-0dda1bed9ea5', 'volume_name': 'volume-f98b11be-a383-4306-90e7-0dda1bed9ea5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6beaacd-d8f2-4d7a-8c33-310fa7495d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6beaacd-d8f2-4d7a-8c33-310fa7495d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2811bfb2-4d42-40cb-914e-eef5bb273e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume f98b11be-a383-4306-90e7-0dda1bed9ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98b11be-a383-4306-90e7-0dda1bed9ea5', 'volume_size': 1} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930994373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98b11be-a383-4306-90e7-0dda1bed9ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:35Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Creating volume f98b11be-a383-4306-90e7-0dda1bed9ea5 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:35 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:35 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 1073741824 Sep 25 16:26:35 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (57b0051b-e1b1-4526-9604-64f46137d68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba89df-883d-452e-98cb-15b5211fbfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba89df-883d-452e-98cb-15b5211fbfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958578365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82be40e1-9d69-499b-a402-48886e8f53c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:35Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78079972-1674-477f-8672-75c7cb902318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78079972-1674-477f-8672-75c7cb902318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd606a0-da9b-4141-9e55-8ce4533e4625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd606a0-da9b-4141-9e55-8ce4533e4625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82be40e1-9d69-499b-a402-48886e8f53c3', 'volume_name': 'volume-82be40e1-9d69-499b-a402-48886e8f53c3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6834c29-0dbe-49bf-bcd6-59f6baf923eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6834c29-0dbe-49bf-bcd6-59f6baf923eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a03fa17-b2ca-43b0-89b1-4d99bcb72471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume 82be40e1-9d69-499b-a402-48886e8f53c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82be40e1-9d69-499b-a402-48886e8f53c3', 'volume_size': 1} Sep 25 16:26:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:36 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 1073741824" returned: 0 in 0.605s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:36 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 Sep 25 16:26:36 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:36 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5" returned: 0 in 0.316s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958578365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82be40e1-9d69-499b-a402-48886e8f53c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:35Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Creating volume 82be40e1-9d69-499b-a402-48886e8f53c3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:36 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3 1073741824 Sep 25 16:26:36 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2811bfb2-4d42-40cb-914e-eef5bb273e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98b11be-a383-4306-90e7-0dda1bed9ea5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b877d531-802d-4b82-a037-642308d1af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 (f98b11be-a383-4306-90e7-0dda1bed9ea5): created successfully Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b877d531-802d-4b82-a037-642308d1af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (38adcd66-a303-43ca-bf7f-4a746193cff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b7ca4423-91d6-44c6-8cfe-b1c96146e689 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created volume successfully. Sep 25 16:26:37 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3 1073741824" returned: 0 in 0.523s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:37 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3 Sep 25 16:26:37 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:37 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a03fa17-b2ca-43b0-89b1-4d99bcb72471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82be40e1-9d69-499b-a402-48886e8f53c3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2b2813-5254-4fe6-a545-a57c02749c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume volume-82be40e1-9d69-499b-a402-48886e8f53c3 (82be40e1-9d69-499b-a402-48886e8f53c3): created successfully Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2b2813-5254-4fe6-a545-a57c02749c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (57b0051b-e1b1-4526-9604-64f46137d68a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c43877a7-914d-44e2-8101-78e45d070dbd tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created volume successfully. Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Creating offline snapshot 306082b4-3f97-4c7c-b24a-dde44fff4542 of volume f98b11be-a383-4306-90e7-0dda1bed9ea5 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aa8dfe-769a-4956-b9c2-7285f664b97d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:38 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 Sep 25 16:26:38 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (d5e14290-d425-47df-aed8-b1939697aa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcbfaa3-e5f6-42eb-879a-ece72a225f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:38 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcbfaa3-e5f6-42eb-879a-ece72a225f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-865349856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d9f0ff-2a70-47e7-bcfc-dad898a8a40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:38Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0053b1-6a51-4b8a-a3f6-390b1c350fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0053b1-6a51-4b8a-a3f6-390b1c350fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35754d3c-b2bf-43a1-85d6-484d3648efec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35754d3c-b2bf-43a1-85d6-484d3648efec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d9f0ff-2a70-47e7-bcfc-dad898a8a40b', 'volume_name': 'volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767d2a9a-36e7-45e5-b7eb-740ebfdff6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767d2a9a-36e7-45e5-b7eb-740ebfdff6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e91998-ba3e-4d88-89ea-8fddf849d0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:38 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume 71d9f0ff-2a70-47e7-bcfc-dad898a8a40b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b', 'volume_size': 1} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5" returned: 0 in 0.602s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:38 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 1G Sep 25 16:26:38 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (4fd18416-d512-443b-8b3b-b47bb94532b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a885383-e0ab-4931-a3c5-6edcf11c0728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a885383-e0ab-4931-a3c5-6edcf11c0728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423792046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7004ea33-f6f4-418b-a0b3-99368f3b4830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:39Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ba13fa-7eae-4dc1-95d4-79393474d675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ba13fa-7eae-4dc1-95d4-79393474d675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca76d18-eb1f-428b-a6d2-153593e6319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca76d18-eb1f-428b-a6d2-153593e6319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7004ea33-f6f4-418b-a0b3-99368f3b4830', 'volume_name': 'volume-7004ea33-f6f4-418b-a0b3-99368f3b4830', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c29dc7e-74e1-4afe-b06b-424031e4c92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c29dc7e-74e1-4afe-b06b-424031e4c92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b62d702-6af4-475b-bcba-951f86f6d327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume 7004ea33-f6f4-418b-a0b3-99368f3b4830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7004ea33-f6f4-418b-a0b3-99368f3b4830', 'volume_size': 1} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 1G" returned: 0 in 0.722s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:39 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 Sep 25 16:26:39 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (e068dc96-ed68-4253-80e1-5e7c7ab8452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d8c4c0-9bd7-4fa2-b362-f9ae936fe529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d8c4c0-9bd7-4fa2-b362-f9ae936fe529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794681246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fbd23dc-94bc-46cc-9890-9c8fa6ab297a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:40Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7482ef14-7ff6-4131-b08f-8f7a252ea871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7482ef14-7ff6-4131-b08f-8f7a252ea871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38b2221-5473-4715-9ec6-fda5ec5657c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38b2221-5473-4715-9ec6-fda5ec5657c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fbd23dc-94bc-46cc-9890-9c8fa6ab297a', 'volume_name': 'volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab528f3-ecab-4289-8a01-39d1b780f69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab528f3-ecab-4289-8a01-39d1b780f69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995ee201-c5a0-4da1-956e-8ded9e9127aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume 9fbd23dc-94bc-46cc-9890-9c8fa6ab297a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a', 'volume_size': 1} Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:39 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542" returned: 0 in 0.568s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:39 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 is being set with open permissions: ugo+rw Sep 25 16:26:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:39 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 Sep 25 16:26:39 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:40 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542" returned: 0 in 0.356s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:40 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.info Sep 25 16:26:40 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (fe6d714e-7d0a-4ea1-ac2b-fb31d3259d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ccaa7e-3c3e-4313-8622-3cac879dbda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ccaa7e-3c3e-4313-8622-3cac879dbda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850231356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b00b4e-ce82-4340-96da-905d58d91acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:40Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938d2e11-e344-4b16-9998-941377de393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938d2e11-e344-4b16-9998-941377de393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb7443a-b8dd-4f4a-9f7e-44794391c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb7443a-b8dd-4f4a-9f7e-44794391c32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b00b4e-ce82-4340-96da-905d58d91acb', 'volume_name': 'volume-c0b00b4e-ce82-4340-96da-905d58d91acb', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49400c35-b05e-4ac4-920f-95accff7a31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49400c35-b05e-4ac4-920f-95accff7a31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410ec734-6068-41f6-b483-d94e42ac1769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume c0b00b4e-ce82-4340-96da-905d58d91acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b00b4e-ce82-4340-96da-905d58d91acb', 'volume_size': 1} Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:40 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.info" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:40 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.info is being set with open permissions: ugo+rw Sep 25 16:26:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:40 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.info Sep 25 16:26:40 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:41 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.info" returned: 0 in 0.422s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.235s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-865349856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d9f0ff-2a70-47e7-bcfc-dad898a8a40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:38Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Creating volume 71d9f0ff-2a70-47e7-bcfc-dad898a8a40b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:41 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:41 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b 1073741824 Sep 25 16:26:41 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8fa45f2e-6c10-41ec-ac06-199a388b23b3 tempest-CreateVolumesFromSnapshotTest-210769379 None] Create snapshot completed successfully Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (52a22109-8487-425c-82d6-feb4f98a2cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6657e8-9e82-406a-acce-92f1139303a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Flow 'volume_create_manager' (e1767c13-c78c-41d1-ac18-f77940a71967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9586a433-778a-47de-9146-4bebfe01a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9586a433-778a-47de-9146-4bebfe01a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffe97e9-c3d1-447e-9dec-9be9b26ef7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885c3d0cae6149feb2e69e0f87974f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:41Z,use_quota=True,user_id='88a3166d38db4543a777def30af71b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d886f2d-6d5a-4a32-9a5a-ee144639b3b7),volume_type_id=0d886f2d-6d5a-4a32-9a5a-ee144639b3b7)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e62a24-af0b-44ce-b168-32157f344a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e62a24-af0b-44ce-b168-32157f344a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c71f7fa-c57b-49b5-b13b-56d89945a5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6657e8-9e82-406a-acce-92f1139303a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-943671779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10b8032-b869-4518-ad19-8585ccc80525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:41Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c1a9ab-920c-4d6a-86b6-95d7cb285845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c1a9ab-920c-4d6a-86b6-95d7cb285845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66ed6e9-7c2a-41aa-800f-7e663dc2f0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66ed6e9-7c2a-41aa-800f-7e663dc2f0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10b8032-b869-4518-ad19-8585ccc80525', 'volume_name': 'volume-e10b8032-b869-4518-ad19-8585ccc80525', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ed5132-8b5a-41af-97ad-b8e029a6c266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ed5132-8b5a-41af-97ad-b8e029a6c266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfdcb85-a68d-49ec-8eb4-82e3137ebd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume e10b8032-b869-4518-ad19-8585ccc80525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10b8032-b869-4518-ad19-8585ccc80525', 'volume_size': 1} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:41 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b 1073741824" returned: 0 in 0.563s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:41 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b Sep 25 16:26:41 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:42 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c71f7fa-c57b-49b5-b13b-56d89945a5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bffe97e9-c3d1-447e-9dec-9be9b26ef7d5', 'volume_name': 'volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5', 'volume_size': 1, 'image_id': '6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01b1a08761e58313f79287e9af15c44b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '885c3d0cae6149feb2e69e0f87974f62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01c7a03eddf211bb95e0c02f9c6bd4473f80988469cdb4258c1154e8e5dfc90473c50b9ff558a32a825f489fb51fe2b542169aab85ef49ea7efc44cb51a88cc3', 'id': '6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'created_at': datetime.datetime(2026, 9, 25, 14, 26, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 26, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d1d3abf-6c0c-43f6-8911-1870f433a9dc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ab2527-7d6c-4a22-9b2a-0ff48da4be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ab2527-7d6c-4a22-9b2a-0ff48da4be1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964fc400-6a2f-498a-8d0f-8a0fb9f7b2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Volume bffe97e9-c3d1-447e-9dec-9be9b26ef7d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5', 'volume_size': 1, 'image_id': '6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01b1a08761e58313f79287e9af15c44b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '885c3d0cae6149feb2e69e0f87974f62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01c7a03eddf211bb95e0c02f9c6bd4473f80988469cdb4258c1154e8e5dfc90473c50b9ff558a32a825f489fb51fe2b542169aab85ef49ea7efc44cb51a88cc3', 'id': '6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'created_at': datetime.datetime(2026, 9, 25, 14, 26, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 26, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d1d3abf-6c0c-43f6-8911-1870f433a9dc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Trying to clone bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 from image 6d1d3abf-6c0c-43f6-8911-1870f433a9dc at location (None, [{'url': 'file:///opt/stack/data/glance/images/6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.835s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423792046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7004ea33-f6f4-418b-a0b3-99368f3b4830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:39Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Creating volume 7004ea33-f6f4-418b-a0b3-99368f3b4830 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:42 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e91998-ba3e-4d88-89ea-8fddf849d0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5720228c-47bb-4e40-9371-fa85b3fc1a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:42 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 1073741824 Sep 25 16:26:42 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b (71d9f0ff-2a70-47e7-bcfc-dad898a8a40b): created successfully Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5720228c-47bb-4e40-9371-fa85b3fc1a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (d5e14290-d425-47df-aed8-b1939697aa56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-355f33bf-f278-4d8e-89fc-5a8ce68e4b01 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created volume successfully. Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:26:42 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddc2432-f714-4e53-a629-1b0132050846]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:42 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD Sep 25 16:26:42 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:43 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 1073741824" returned: 0 in 0.936s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:43 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:43 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 Sep 25 16:26:43 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (674b3a25-f632-4925-b944-476bcf315536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1350df-c4cc-4a5a-814e-5c3784b5467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1350df-c4cc-4a5a-814e-5c3784b5467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-452340144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0e0b0b-74f6-4573-8337-ad2075dcdee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:43Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff9cac9-4c65-4d52-a2fd-4aae2345158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff9cac9-4c65-4d52-a2fd-4aae2345158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:43 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD Sep 25 16:26:43 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fbe0dc-e02c-46ed-be13-4ce7eeeb801f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fbe0dc-e02c-46ed-be13-4ce7eeeb801f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0e0b0b-74f6-4573-8337-ad2075dcdee8', 'volume_name': 'volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9a20fa-24cc-45d0-bde2-769049ff0c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9a20fa-24cc-45d0-bde2-769049ff0c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704e306b-5781-40e0-b59f-3b66c945cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:43 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume 2e0e0b0b-74f6-4573-8337-ad2075dcdee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8', 'volume_size': 1} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:43 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830" returned: 0 in 0.498s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.872s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794681246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fbd23dc-94bc-46cc-9890-9c8fa6ab297a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:40Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Creating volume 9fbd23dc-94bc-46cc-9890-9c8fa6ab297a {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:43 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:43 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a 1073741824 Sep 25 16:26:43 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b62d702-6af4-475b-bcba-951f86f6d327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7004ea33-f6f4-418b-a0b3-99368f3b4830', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6654d7c4-626c-41a6-812e-2a6b9fde75b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:43 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 (7004ea33-f6f4-418b-a0b3-99368f3b4830): created successfully Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6654d7c4-626c-41a6-812e-2a6b9fde75b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (4fd18416-d512-443b-8b3b-b47bb94532b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:43 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD" returned: 1 in 0.680s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:26:43 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Temporary image 6d1d3abf-6c0c-43f6-8911-1870f433a9dc is fetched for user 88a3166d38db4543a777def30af71b0d. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:26:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-64a25108-eef5-417b-aa6a-6149fbdbbca2 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created volume successfully. Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dbf400-1ca8-4553-ad44-97fd24bea77e]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (b2e7f6b1-0844-40c1-a0b7-7e909ec347a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f1d20c-c9cd-4f54-9267-be333ab70bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD Sep 25 16:26:44 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f1d20c-c9cd-4f54-9267-be333ab70bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1192249176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b922e146-5595-43b7-aeca-9b21b3257c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:44Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be804179-cc64-403b-b1c5-7930e15e9989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be804179-cc64-403b-b1c5-7930e15e9989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a13d9f9-9c8f-4d0e-9f30-e39f3d20da3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a13d9f9-9c8f-4d0e-9f30-e39f3d20da3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b922e146-5595-43b7-aeca-9b21b3257c06', 'volume_name': 'volume-b922e146-5595-43b7-aeca-9b21b3257c06', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34145e24-7330-4c9c-96a6-5340c3459f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34145e24-7330-4c9c-96a6-5340c3459f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566ee34b-d238-4dda-a066-1229603f5ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume b922e146-5595-43b7-aeca-9b21b3257c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b922e146-5595-43b7-aeca-9b21b3257c06', 'volume_size': 1} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:44 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a 1073741824" returned: 0 in 0.786s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:44 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a Sep 25 16:26:44 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (0575c30c-ea0f-4d65-ac42-b62aa58b552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc348735-8a35-41f0-9532-fea2a191a057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc348735-8a35-41f0-9532-fea2a191a057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314130496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c830b0a1-8dcb-4eea-ad78-f1998a1aa54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:45Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a38c97-9ce8-491e-83d6-0edd08f0b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a38c97-9ce8-491e-83d6-0edd08f0b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323880d8-2497-413b-84f1-2dc3a8fc9dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323880d8-2497-413b-84f1-2dc3a8fc9dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c830b0a1-8dcb-4eea-ad78-f1998a1aa54f', 'volume_name': 'volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6acee16-6dac-4699-9c8a-0b623ffbe4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6acee16-6dac-4699-9c8a-0b623ffbe4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17348ccb-7b8a-4670-8a51-787978f519c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume c830b0a1-8dcb-4eea-ad78-f1998a1aa54f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f', 'volume_size': 1} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:44 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD Sep 25 16:26:44 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:44 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a" returned: 0 in 0.422s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.349s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850231356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b00b4e-ce82-4340-96da-905d58d91acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:40Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Creating volume c0b00b4e-ce82-4340-96da-905d58d91acb {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:45 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995ee201-c5a0-4da1-956e-8ded9e9127aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259459a3-4c97-4398-aeb9-829e3838844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb 1073741824 Sep 25 16:26:45 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a (9fbd23dc-94bc-46cc-9890-9c8fa6ab297a): created successfully Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259459a3-4c97-4398-aeb9-829e3838844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (e068dc96-ed68-4253-80e1-5e7c7ab8452b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5a808444-9096-446f-aec5-eb35847b87b4 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created volume successfully. Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (aa18a858-babd-4867-8938-ade5164980d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:45 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b9f165-d500-4e6b-ac82-a1fb092edc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD" returned: 1 in 0.569s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b9f165-d500-4e6b-ac82-a1fb092edc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1953168617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af34c564-05e9-4416-8482-33bb38969c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:45Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a136a77-12a7-4c57-a60d-a1de68fbd410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a136a77-12a7-4c57-a60d-a1de68fbd410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66fcc47-9763-4c7e-b8f2-c6a6e23a7306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66fcc47-9763-4c7e-b8f2-c6a6e23a7306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af34c564-05e9-4416-8482-33bb38969c03', 'volume_name': 'volume-af34c564-05e9-4416-8482-33bb38969c03', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4691ceae-542f-42aa-8934-9c3e3e90ea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4691ceae-542f-42aa-8934-9c3e3e90ea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0342218-4c43-434b-b750-5d92e9125575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume af34c564-05e9-4416-8482-33bb38969c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af34c564-05e9-4416-8482-33bb38969c03', 'volume_size': 1} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:45 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb 1073741824" returned: 0 in 0.660s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:45 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb Sep 25 16:26:45 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (3ec669e9-1303-4f57-afcd-721da493b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167a7101-f3b2-454b-8d4f-39d7195855d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167a7101-f3b2-454b-8d4f-39d7195855d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1515321953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7989a02-ad14-4b25-99b2-3a5cab8ee042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:46Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912cf57e-4a65-46cc-9469-249c53f6514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912cf57e-4a65-46cc-9469-249c53f6514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6125e3c8-013a-4570-9e0a-fbe186557e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6125e3c8-013a-4570-9e0a-fbe186557e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7989a02-ad14-4b25-99b2-3a5cab8ee042', 'volume_name': 'volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9f0d09-024a-4cef-a612-dd98fb89608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9f0d09-024a-4cef-a612-dd98fb89608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8939be7-23d9-497c-9b4e-5654090d30d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume d7989a02-ad14-4b25-99b2-3a5cab8ee042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042', 'volume_size': 1} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:45 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.416s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-943671779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10b8032-b869-4518-ad19-8585ccc80525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ebb742ad6141b78700398492bad30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:41Z,use_quota=True,user_id='22ae9c4825e947509754d07a9269c81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Creating volume e10b8032-b869-4518-ad19-8585ccc80525 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:46 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410ec734-6068-41f6-b483-d94e42ac1769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b00b4e-ce82-4340-96da-905d58d91acb', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04234691-24b6-414b-aa87-53e61c31c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:46 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525 1073741824 Sep 25 16:26:46 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume volume-c0b00b4e-ce82-4340-96da-905d58d91acb (c0b00b4e-ce82-4340-96da-905d58d91acb): created successfully Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04234691-24b6-414b-aa87-53e61c31c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (fe6d714e-7d0a-4ea1-ac2b-fb31d3259d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5a7f9e69-72be-4670-9b0a-d0f1d516075e tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created volume successfully. Sep 25 16:26:46 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525 1073741824" returned: 0 in 0.508s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:46 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525 Sep 25 16:26:46 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:46 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.293s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-452340144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0e0b0b-74f6-4573-8337-ad2075dcdee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:43Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Creating volume 2e0e0b0b-74f6-4573-8337-ad2075dcdee8 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:46 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfdcb85-a68d-49ec-8eb4-82e3137ebd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10b8032-b869-4518-ad19-8585ccc80525', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c2b701-9280-4f84-b5d3-79f7d40cf9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:46 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 1073741824 Sep 25 16:26:46 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Volume volume-e10b8032-b869-4518-ad19-8585ccc80525 (e10b8032-b869-4518-ad19-8585ccc80525): created successfully Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c2b701-9280-4f84-b5d3-79f7d40cf9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Flow 'volume_create_manager' (52a22109-8487-425c-82d6-feb4f98a2cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-33040c82-775f-4ac7-9a9f-2a6c5539f0f0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created volume successfully. Sep 25 16:26:47 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 1073741824" returned: 0 in 0.500s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:47 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 Sep 25 16:26:47 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:47 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8" returned: 0 in 0.241s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.212s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1192249176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b922e146-5595-43b7-aeca-9b21b3257c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:44Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Creating volume b922e146-5595-43b7-aeca-9b21b3257c06 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:47 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704e306b-5781-40e0-b59f-3b66c945cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f527690-d97b-4634-97d7-19a059a7504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:47 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06 1073741824 Sep 25 16:26:47 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 (2e0e0b0b-74f6-4573-8337-ad2075dcdee8): created successfully Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f527690-d97b-4634-97d7-19a059a7504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (674b3a25-f632-4925-b944-476bcf315536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4e116920-a2a0-4e39-8a63-bafeb13d9c67 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created volume successfully. Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-e10b8032-b869-4518-ad19-8585ccc80525-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-e10b8032-b869-4518-ad19-8585ccc80525-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-quobyte-e10b8032-b869-4518-ad19-8585ccc80525" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-e10b8032-b869-4518-ad19-8585ccc80525" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dbcfe2-7b66-41b2-b4d8-1acbceb69559]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:48 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525 Sep 25 16:26:48 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:48 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06 1073741824" returned: 0 in 0.725s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:48 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06 Sep 25 16:26:48 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:48 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525" returned: 0 in 0.538s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:48 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525 Sep 25 16:26:48 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:48 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.926s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314130496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c830b0a1-8dcb-4eea-ad78-f1998a1aa54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:45Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Creating volume c830b0a1-8dcb-4eea-ad78-f1998a1aa54f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:48 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:48 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f 1073741824 Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566ee34b-d238-4dda-a066-1229603f5ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b922e146-5595-43b7-aeca-9b21b3257c06', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:48 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824d9049-5b97-4179-a707-3ee16627fb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e10b8032-b869-4518-ad19-8585ccc80525" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume volume-b922e146-5595-43b7-aeca-9b21b3257c06 (b922e146-5595-43b7-aeca-9b21b3257c06): created successfully Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824d9049-5b97-4179-a707-3ee16627fb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (b2e7f6b1-0844-40c1-a0b7-7e909ec347a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-e10b8032-b869-4518-ad19-8585ccc80525" released by "delete_volume" :: held 0.899s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e3462130-4f42-4de9-8b76-e36e389635a8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created volume successfully. Sep 25 16:26:48 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created reservations ['b9f83c60-0693-45d0-908a-b46d92ebf408', 'b79c9ec9-fb2c-4f0e-9d9e-93ff58c33642', 'a22913ed-fac2-4131-bc9c-d6032355ae18', '70dd6151-7930-49be-a85b-e859bfd014e6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-c0b00b4e-ce82-4340-96da-905d58d91acb-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:49 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:49 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-c0b00b4e-ce82-4340-96da-905d58d91acb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-quobyte-c0b00b4e-ce82-4340-96da-905d58d91acb" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-c0b00b4e-ce82-4340-96da-905d58d91acb" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aae0258-f53b-4b5a-9ff6-f0f5793132a2]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:49 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f 1073741824" returned: 0 in 0.727s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:49 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:49 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb Sep 25 16:26:49 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Deleted volume successfully. Sep 25 16:26:49 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f Sep 25 16:26:49 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-26ed0df4-dc56-48dd-9fa3-60680fb26401 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-e10b8032-b869-4518-ad19-8585ccc80525-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:49 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb" returned: 0 in 0.441s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:49 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.438s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffe97e9-c3d1-447e-9dec-9be9b26ef7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885c3d0cae6149feb2e69e0f87974f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:41Z,use_quota=True,user_id='88a3166d38db4543a777def30af71b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d886f2d-6d5a-4a32-9a5a-ee144639b3b7),volume_type_id=0d886f2d-6d5a-4a32-9a5a-ee144639b3b7)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Creating volume bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:49 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:49 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb Sep 25 16:26:49 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17348ccb-7b8a-4670-8a51-787978f519c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 1073741824 Sep 25 16:26:49 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf54d299-9d29-421c-8c11-f147812cdb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f (c830b0a1-8dcb-4eea-ad78-f1998a1aa54f): created successfully Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf54d299-9d29-421c-8c11-f147812cdb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (0575c30c-ea0f-4d65-ac42-b62aa58b552d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7a81f82a-ebfb-496e-846b-2ba56bf8b490 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created volume successfully. Sep 25 16:26:50 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c0b00b4e-ce82-4340-96da-905d58d91acb" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-c0b00b4e-ce82-4340-96da-905d58d91acb" released by "delete_volume" :: held 0.905s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created reservations ['52fff23a-f29d-4c85-b0f9-ec332fc7893a', 'c6946088-834e-4092-98b2-968e3a792220', 'e601ba76-40a7-484d-8b4c-f932347c6df7', '4c7e5a46-620e-4499-9cfb-266a9a38d0f6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:50 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:50 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:50 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 1073741824" returned: 0 in 0.747s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:50 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 Sep 25 16:26:50 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:50 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.340s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Deleted volume successfully. Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e4e2fc2-d75a-40fd-9144-443f6dbb23c0 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-c0b00b4e-ce82-4340-96da-905d58d91acb-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:50 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.536s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1953168617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af34c564-05e9-4416-8482-33bb38969c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:45Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Creating volume af34c564-05e9-4416-8482-33bb38969c03 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:51 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:51 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03 1073741824 Sep 25 16:26:51 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Attempting download of 6d1d3abf-6c0c-43f6-8911-1870f433a9dc ((None, [{'url': 'file:///opt/stack/data/glance/images/6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'metadata': {}}])) to volume bffe97e9-c3d1-447e-9dec-9be9b26ef7d5. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[be96631b-381d-4ba4-bd42-67105e76d79d]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_7v80ojqp {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:51 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_7v80ojqp Sep 25 16:26:51 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-quobyte-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:51 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6dce12-ae1a-4af4-b79b-945f938e48a6]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_7v80ojqp" returned: 0 in 0.550s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_7v80ojqp {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:51 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03 1073741824" returned: 0 in 0.777s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:51 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03 Sep 25 16:26:51 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:51 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a Sep 25 16:26:51 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:51 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_7v80ojqp Sep 25 16:26:51 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:52 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a" returned: 0 in 0.551s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:52 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_7v80ojqp" returned: 1 in 0.581s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_7v80ojqp' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:26:52 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a Sep 25 16:26:52 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f6923-1374-45ee-870a-84c976e00241]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:52 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03" returned: 0 in 0.523s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.499s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1515321953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7989a02-ad14-4b25-99b2-3a5cab8ee042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0228334a954ba7b9b116c1a5c04599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:46Z,use_quota=True,user_id='945d90489e6e4d2380c0ad45caab1623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Creating volume d7989a02-ad14-4b25-99b2-3a5cab8ee042 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:52 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:52 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 1073741824 Sep 25 16:26:52 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:52 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD Sep 25 16:26:52 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0342218-4c43-434b-b750-5d92e9125575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af34c564-05e9-4416-8482-33bb38969c03', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814147dd-b7ea-44db-8568-45813a77483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume volume-af34c564-05e9-4416-8482-33bb38969c03 (af34c564-05e9-4416-8482-33bb38969c03): created successfully Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814147dd-b7ea-44db-8568-45813a77483f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (aa18a858-babd-4867-8938-ade5164980d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dd4ddb21-4a96-47f6-90d1-a149a0b18dd8 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created volume successfully. Sep 25 16:26:52 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a" returned: 0 in 0.474s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:52 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a" released by "delete_volume" :: held 1.114s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created reservations ['fd6f833c-a0de-42b9-8d3b-8a1c5c08ea0d', 'f2764606-b20f-483c-8d42-bc40df8c67e2', '9573db5a-46aa-45c4-b658-7c36f42d4e14', '3b7be6e5-35b4-40db-b85e-d06000a4cc52'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:52 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD Sep 25 16:26:52 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:53 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:53 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:53 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 1073741824" returned: 0 in 0.655s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:53 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 Sep 25 16:26:53 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:53 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD" returned: 1 in 0.474s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] 6d1d3abf-6c0c-43f6-8911-1870f433a9dc was raw, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1150}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:53 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.333s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:53 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:53 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Deleted volume successfully. Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3154ede3-9dd5-431f-9846-add5b96b8642 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-9fbd23dc-94bc-46cc-9890-9c8fa6ab297a-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:53 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8939be7-23d9-497c-9b4e-5654090d30d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bf3069-f5d8-4a3d-9403-76ca0bbda9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:53 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Volume volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 (d7989a02-ad14-4b25-99b2-3a5cab8ee042): created successfully Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bf3069-f5d8-4a3d-9403-76ca0bbda9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Flow 'volume_create_manager' (3ec669e9-1303-4f57-afcd-721da493b632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6b6339d8-22fc-4fab-9091-5bfb29106230 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created volume successfully. Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-d7989a02-ad14-4b25-99b2-3a5cab8ee042-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-d7989a02-ad14-4b25-99b2-3a5cab8ee042-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-7004ea33-f6f4-418b-a0b3-99368f3b4830-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-quobyte-d7989a02-ad14-4b25-99b2-3a5cab8ee042" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-7004ea33-f6f4-418b-a0b3-99368f3b4830-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-d7989a02-ad14-4b25-99b2-3a5cab8ee042" acquired by "delete_volume" :: waited 0.045s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fea725-1091-4e11-a77f-b9bbf2f71e15]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-quobyte-7004ea33-f6f4-418b-a0b3-99368f3b4830" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-7004ea33-f6f4-418b-a0b3-99368f3b4830" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f856bc-601f-46bd-816c-0f91b9b2b547]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:54 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 Sep 25 16:26:54 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:54 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5" returned: 0 in 0.992s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6d1d3abf-6c0c-43f6-8911-1870f433a9dc_zab58fyddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:26:54 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:54 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 Sep 25 16:26:54 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:54 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 1G Sep 25 16:26:54 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:54 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042" returned: 0 in 0.717s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:54 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042 Sep 25 16:26:54 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:54 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 1G" returned: 0 in 0.551s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Downloaded image 6d1d3abf-6c0c-43f6-8911-1870f433a9dc ((None, [{'url': 'file:///opt/stack/data/glance/images/6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'metadata': {}}])) to volume bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Temporary image 6d1d3abf-6c0c-43f6-8911-1870f433a9dc for user 88a3166d38db4543a777def30af71b0d is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Marking volume bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:26:54 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830" returned: 0 in 0.700s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Copying metadata from image 6d1d3abf-6c0c-43f6-8911-1870f433a9dc to bffe97e9-c3d1-447e-9dec-9be9b26ef7d5. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Creating volume glance metadata for volume bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 backed by image 6d1d3abf-6c0c-43f6-8911-1870f433a9dc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '01b1a08761e58313f79287e9af15c44b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:26:54 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830 Sep 25 16:26:54 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964fc400-6a2f-498a-8d0f-8a0fb9f7b2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5', 'volume_size': 1, 'image_id': '6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01b1a08761e58313f79287e9af15c44b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '885c3d0cae6149feb2e69e0f87974f62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01c7a03eddf211bb95e0c02f9c6bd4473f80988469cdb4258c1154e8e5dfc90473c50b9ff558a32a825f489fb51fe2b542169aab85ef49ea7efc44cb51a88cc3', 'id': '6d1d3abf-6c0c-43f6-8911-1870f433a9dc', 'created_at': datetime.datetime(2026, 9, 25, 14, 26, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 26, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d1d3abf-6c0c-43f6-8911-1870f433a9dc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0124954-7b0c-420f-9ff7-9b0138ce677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:55 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Volume volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 (bffe97e9-c3d1-447e-9dec-9be9b26ef7d5): created successfully Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0124954-7b0c-420f-9ff7-9b0138ce677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Flow 'volume_create_manager' (e1767c13-c78c-41d1-ac18-f77940a71967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-99d7bfdd-5a2c-4434-b8ad-50375fc53967 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Created volume successfully. Sep 25 16:26:55 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-d7989a02-ad14-4b25-99b2-3a5cab8ee042" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-d7989a02-ad14-4b25-99b2-3a5cab8ee042" released by "delete_volume" :: held 1.181s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:55 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-7004ea33-f6f4-418b-a0b3-99368f3b4830" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-7004ea33-f6f4-418b-a0b3-99368f3b4830" released by "delete_volume" :: held 1.161s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Created reservations ['3c13698e-3ab9-449a-bcb6-f1326940cef0', '0b449a22-380a-4b44-9ddb-79a2ef5ee89d', 'e4248790-a253-4821-981d-8cc30179ad29', '539e30c4-4eb3-4e7b-955f-be090fa8a176'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created reservations ['ee885f78-ff0b-4683-85a2-eb42fba7d125', '1b3f34b5-fb8a-4310-95cb-a5361778ba09', '8f8cb15b-f0d7-47e1-aa50-1d5448fa313a', 'fd86d830-6ec2-4f36-99ce-e9d7203d041b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:55 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:55 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:55 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:55 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:55 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.303s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Deleted volume successfully. Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f47732e9-4423-44b9-b0bc-af0ba244bc8c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-d7989a02-ad14-4b25-99b2-3a5cab8ee042-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:55 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Deleted volume successfully. Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Acquiring lock "cinder-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "cinder-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b25fb4ad-a71d-4c81-9ef5-2adbe4c085da tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-7004ea33-f6f4-418b-a0b3-99368f3b4830-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Acquiring lock "cinder-quobyte-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "cinder-quobyte-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7d7aad-8140-42c0-837d-e0d538b3bd8b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:56 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 Sep 25 16:26:56 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-af34c564-05e9-4416-8482-33bb38969c03-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-af34c564-05e9-4416-8482-33bb38969c03-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-quobyte-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-quobyte-af34c564-05e9-4416-8482-33bb38969c03" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:56 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b" acquired by "delete_volume" :: waited 0.041s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5" returned: 0 in 0.585s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-af34c564-05e9-4416-8482-33bb38969c03" acquired by "delete_volume" :: waited 0.056s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2840115-ab4a-4f27-b81f-c34583bdca8e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e7705-527f-4f66-81ef-6378ff530ded]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:56 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5 Sep 25 16:26:56 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:56 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03 Sep 25 16:26:56 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:56 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b Sep 25 16:26:56 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:56 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "cinder-quobyte-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5" released by "delete_volume" :: held 1.042s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Created reservations ['0ef2bbe3-266a-42c7-815b-96e18416be17', 'a9858237-e9af-4ef5-9ff7-f64e66a77a21', 'ae35f413-766d-4f43-982e-1d46d7491f9c', 'e630ca4f-fad7-40b2-8282-6a8db7a388b9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:57 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03" returned: 0 in 0.496s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:57 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b" returned: 0 in 0.542s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:57 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03 Sep 25 16:26:57 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:57 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b Sep 25 16:26:57 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:57 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:57 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:57 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-af34c564-05e9-4416-8482-33bb38969c03" returned: 0 in 0.360s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-af34c564-05e9-4416-8482-33bb38969c03" released by "delete_volume" :: held 0.941s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:57 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b" returned: 0 in 0.440s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:57 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.358s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b" released by "delete_volume" :: held 1.069s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Created reservations ['d35f51d7-3ad1-4d04-9b1b-99e5e0000ed2', 'a12a6729-ae3d-40a1-93bd-5ab32a4b74a7', '5aba042c-85f7-41da-a711-4742d6a5a5c3', '6b99bcf8-cd6a-4d1e-a38f-f9510e767e0a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Deleted volume successfully. Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dff570a8-d13f-406e-9918-315af5fe4870 tempest-VolumeAndVolumeTypeFromImageTest-153419994 None] Lock "cinder-bffe97e9-c3d1-447e-9dec-9be9b26ef7d5-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created reservations ['a50facb5-6822-4fae-a269-02d4016b07c7', 'f060dd54-11df-4225-80ec-82437494a603', '565838b4-479f-4ab8-88aa-71897fd4d358', 'b6b9edd7-23f1-419a-8418-c08b123e2ff2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:57 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:57 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:57 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:57 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:58 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.324s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Deleted volume successfully. Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-eff459d6-9e75-4d6a-b354-b3527543589f tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-af34c564-05e9-4416-8482-33bb38969c03-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:58 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Deleted volume successfully. Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b53ebb38-450b-49b0-8f3a-a5c5ee4c3faa tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-71d9f0ff-2a70-47e7-bcfc-dad898a8a40b-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:58 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-82be40e1-9d69-499b-a402-48886e8f53c3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:58 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-82be40e1-9d69-499b-a402-48886e8f53c3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-quobyte-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "cinder-quobyte-82be40e1-9d69-499b-a402-48886e8f53c3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-82be40e1-9d69-499b-a402-48886e8f53c3" acquired by "delete_volume" :: waited 0.041s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6c028-7742-4604-9368-dab95f1ef2ea]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93a581a-67bb-4a0c-a12c-9b43bb1a7b36]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:59 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f Sep 25 16:26:59 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:59 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3 Sep 25 16:26:59 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:59 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.519s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:26:59 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f" returned: 0 in 0.530s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:59 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f Sep 25 16:26:59 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:59 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3" returned: 0 in 0.611s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:59 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3 Sep 25 16:26:59 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:59 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f" returned: 0 in 0.315s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f" released by "delete_volume" :: held 0.927s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Created reservations ['721d08aa-9ef3-40e0-a0b7-85e5e71b2e79', '2d3c6f0e-46e4-482e-a9ab-64d8005e0542', 'ac2c19ef-473c-4d83-bc0f-b047c08c5a41', 'ee5a6a1e-72b0-4740-b3e1-3799595fbdf6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:59 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-82be40e1-9d69-499b-a402-48886e8f53c3" returned: 0 in 0.407s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-quobyte-82be40e1-9d69-499b-a402-48886e8f53c3" released by "delete_volume" :: held 1.105s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-b922e146-5595-43b7-aeca-9b21b3257c06-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:00 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:00 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-b922e146-5595-43b7-aeca-9b21b3257c06-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Created reservations ['adde9555-bb61-4970-9f8a-97deac720819', 'bf3fd67d-7fcd-45cc-9774-2f67c32fd34c', '45795176-cf70-4728-a908-292b0fb07b10', '63a35bf9-b9b1-4bd6-9f49-2fd098a7d4c2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-quobyte-b922e146-5595-43b7-aeca-9b21b3257c06" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-b922e146-5595-43b7-aeca-9b21b3257c06" acquired by "delete_volume" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02d8f10-938c-476a-9ca0-f42efc2f594c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:00 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:00 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:00 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Deleted volume successfully. Sep 25 16:27:00 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06 Sep 25 16:27:00 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-814f147b-a0d8-4784-8373-eca51c856d1c tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-c830b0a1-8dcb-4eea-ad78-f1998a1aa54f-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:00 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:00 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06" returned: 0 in 0.482s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Deleted volume successfully. Sep 25 16:27:00 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06 Sep 25 16:27:00 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6f367937-e4bb-473b-a130-a71d57feb727 tempest-CreateVolumesFromSourceVolumeTest-1395074847 None] Lock "cinder-82be40e1-9d69-499b-a402-48886e8f53c3-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:01 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b922e146-5595-43b7-aeca-9b21b3257c06" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-b922e146-5595-43b7-aeca-9b21b3257c06" released by "delete_volume" :: held 0.948s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created reservations ['148549a7-388b-4898-a2ea-846407141b17', '7efa7a10-85bb-41df-99d6-2c5b026519f3', 'f94c44c1-87bf-4087-a9cb-bf1197cd2063', '92257760-d6f2-4491-8c27-7baa19f70226'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:01 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:01 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:01 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Deleted volume successfully. Sep 25 16:27:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5361ad0-4c96-4676-aa12-40f0e43e2ab7 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-b922e146-5595-43b7-aeca-9b21b3257c06-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-2e0e0b0b-74f6-4573-8337-ad2075dcdee8-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-2e0e0b0b-74f6-4573-8337-ad2075dcdee8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-quobyte-2e0e0b0b-74f6-4573-8337-ad2075dcdee8" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-2e0e0b0b-74f6-4573-8337-ad2075dcdee8" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6dd3df-5dd1-4a52-8c1e-4a28e569f8f2]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:02 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 Sep 25 16:27:02 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:03 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8" returned: 0 in 0.508s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:03 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8 Sep 25 16:27:03 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:03 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-2e0e0b0b-74f6-4573-8337-ad2075dcdee8" returned: 0 in 0.450s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-2e0e0b0b-74f6-4573-8337-ad2075dcdee8" released by "delete_volume" :: held 1.049s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created reservations ['c8d2f84d-7ed2-4632-8240-03ee1f4b083f', 'bb341605-f9b7-41e7-8cdf-fdbf449cc4df', '29c33a7a-2c43-4a21-a4e1-2c21cdab7acd', '7268f998-c170-4a46-9326-c30b7c3258d3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:03 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:03 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:04 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.613s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:04 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Deleted volume successfully. Sep 25 16:27:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36cef9e7-f613-4be1-b86f-d4c17b329a88 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-2e0e0b0b-74f6-4573-8337-ad2075dcdee8-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-306082b4-3f97-4c7c-b24a-dde44fff4542-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-306082b4-3f97-4c7c-b24a-dde44fff4542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-quobyte-f98b11be-a383-4306-90e7-0dda1bed9ea5" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-f98b11be-a383-4306-90e7-0dda1bed9ea5" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-quobyte-306082b4-3f97-4c7c-b24a-dde44fff4542" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-306082b4-3f97-4c7c-b24a-dde44fff4542" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Deleting offline snapshot 306082b4-3f97-4c7c-b24a-dde44fff4542 of volume f98b11be-a383-4306-90e7-0dda1bed9ea5 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:27:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] snapshot_file for this snap is: volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:27:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f552d45c-7f99-43f2-a56d-59ef72850471]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:05 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 Sep 25 16:27:05 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:05 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542" returned: 0 in 0.923s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98b11be-a383-4306-90e7-0dda1bed9ea5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[39454a9c-4e5d-486d-9466-c0fa03e74512]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:06 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 Sep 25 16:27:06 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (9046bcab-068c-4d9c-9df0-cd85284cdae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3a8606-8bdd-454c-850b-6d12d383ad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3a8606-8bdd-454c-850b-6d12d383ad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1096032265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6154c5-708d-4a42-9253-b244ca9660bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:07Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d60184-fab1-45f4-a61b-a3a575f77dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d60184-fab1-45f4-a61b-a3a575f77dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca3e278-59ae-40d6-9319-568b710fd86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca3e278-59ae-40d6-9319-568b710fd86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6154c5-708d-4a42-9253-b244ca9660bc', 'volume_name': 'volume-ff6154c5-708d-4a42-9253-b244ca9660bc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c56649-6de6-43bc-bb6b-40cb306a0d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c56649-6de6-43bc-bb6b-40cb306a0d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f588975-fdc6-494f-8638-f682ffdbd032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Volume ff6154c5-708d-4a42-9253-b244ca9660bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6154c5-708d-4a42-9253-b244ca9660bc', 'volume_size': 1} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1096032265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6154c5-708d-4a42-9253-b244ca9660bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:07Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Creating volume ff6154c5-708d-4a42-9253-b244ca9660bc {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:06 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:06 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5" returned: 0 in 0.878s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:06 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc 1073741824 Sep 25 16:27:06 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:06 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 Sep 25 16:27:06 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (0f3f26b1-50b5-4ada-81ef-9cd63caf4ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88ff2d7-0e5a-4b75-8cad-894ef09fb4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88ff2d7-0e5a-4b75-8cad-894ef09fb4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1059623557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d10b87-6c7a-4c65-9892-57f75d959844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:07Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8079a561-83c1-43c8-a5b3-47323047cad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8079a561-83c1-43c8-a5b3-47323047cad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e96f46-c16f-4683-bbc8-1f53dd524c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e96f46-c16f-4683-bbc8-1f53dd524c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d10b87-6c7a-4c65-9892-57f75d959844', 'volume_name': 'volume-00d10b87-6c7a-4c65-9892-57f75d959844', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c676dda7-311d-4b04-b0f8-621ed9768f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c676dda7-311d-4b04-b0f8-621ed9768f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6c3eda-778f-48b8-bff8-81673b5fa98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Volume 00d10b87-6c7a-4c65-9892-57f75d959844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d10b87-6c7a-4c65-9892-57f75d959844', 'volume_size': 1} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:07 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542" returned: 0 in 0.594s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:07 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542 Sep 25 16:27:07 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:07 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc 1073741824" returned: 0 in 0.910s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (4c3fef6f-ad88-4690-bc1d-af46e8421282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd436b21-11da-41aa-ab2c-bed52f64f777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd436b21-11da-41aa-ab2c-bed52f64f777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013499010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a75dd0-f157-4d53-a061-aa759dd83360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:08Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b8bea7-c7a1-4168-9673-5aa30bf00a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b8bea7-c7a1-4168-9673-5aa30bf00a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d903698f-8491-4eb6-8b94-26f7a46a017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d903698f-8491-4eb6-8b94-26f7a46a017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a75dd0-f157-4d53-a061-aa759dd83360', 'volume_name': 'volume-f5a75dd0-f157-4d53-a061-aa759dd83360', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1916f8-0e0d-4c72-974d-a607b62a7048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1916f8-0e0d-4c72-974d-a607b62a7048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec85aab-5512-4e41-8bbf-cc68a3577132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Volume f5a75dd0-f157-4d53-a061-aa759dd83360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a75dd0-f157-4d53-a061-aa759dd83360', 'volume_size': 1} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:08 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc Sep 25 16:27:08 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:08 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5.306082b4-3f97-4c7c-b24a-dde44fff4542" returned: 0 in 0.500s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-306082b4-3f97-4c7c-b24a-dde44fff4542" released by "_delete_snapshot" :: held 3.156s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-f98b11be-a383-4306-90e7-0dda1bed9ea5" released by "delete_snapshot" :: held 3.205s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created reservations ['073bfe3d-2d48-44ee-b0b7-01751e7c3524', '4e5d62bd-ca79-428d-8db8-3fcfca0dc5a2', '7b4b2590-c767-4908-aaaa-2e91ffc698b4', 'fb81c598-4b6d-43ce-81a3-21cabf5aecbd'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:08 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc" returned: 0 in 0.427s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.985s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1059623557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d10b87-6c7a-4c65-9892-57f75d959844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:07Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Creating volume 00d10b87-6c7a-4c65-9892-57f75d959844 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:08 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844 1073741824 Sep 25 16:27:08 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f588975-fdc6-494f-8638-f682ffdbd032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6154c5-708d-4a42-9253-b244ca9660bc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ae7772-44d0-4793-bb63-1164de8ac035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Volume volume-ff6154c5-708d-4a42-9253-b244ca9660bc (ff6154c5-708d-4a42-9253-b244ca9660bc): created successfully Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ae7772-44d0-4793-bb63-1164de8ac035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (9046bcab-068c-4d9c-9df0-cd85284cdae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Delete snapshot completed successfully. Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2affa38c-342d-4abb-93a1-064710ef7d91 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-306082b4-3f97-4c7c-b24a-dde44fff4542-delete_snapshot" released by "delete_snapshot" :: held 3.773s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (c9461d4b-f13e-4477-8618-eed63e246aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2206d7-243f-4238-b11b-9840a672a9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5b0660cf-be81-44de-bdd3-0df8247f4070 tempest-CreateVolumesFromImageTest-129427107 None] Created volume successfully. Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2206d7-243f-4238-b11b-9840a672a9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344483911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f10809e-5141-4b74-bb78-02e67630c930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:09Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8696ebe9-e1c5-44ec-9e8e-15be712b38cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8696ebe9-e1c5-44ec-9e8e-15be712b38cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469ff990-4151-4987-bddb-98c571207b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469ff990-4151-4987-bddb-98c571207b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f10809e-5141-4b74-bb78-02e67630c930', 'volume_name': 'volume-0f10809e-5141-4b74-bb78-02e67630c930', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927571d9-125e-4b32-a0b9-f0ad2ab9d2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927571d9-125e-4b32-a0b9-f0ad2ab9d2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3300b3e8-da9c-4738-ab2e-7cad03968e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Volume 0f10809e-5141-4b74-bb78-02e67630c930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f10809e-5141-4b74-bb78-02e67630c930', 'volume_size': 1} Sep 25 16:27:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:09 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844 1073741824" returned: 0 in 0.822s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-f98b11be-a383-4306-90e7-0dda1bed9ea5-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-f98b11be-a383-4306-90e7-0dda1bed9ea5-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:09 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844 Sep 25 16:27:09 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (8352828a-1845-4099-b462-d00ac57102db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14ee024-3e30-4941-b018-ae1c7c6e1355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14ee024-3e30-4941-b018-ae1c7c6e1355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1253389087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b036cbe5-f796-4dd6-a887-596f00faa965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:09Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a539dc3-4b40-40d3-af92-32ddf5218755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a539dc3-4b40-40d3-af92-32ddf5218755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c436fcd5-c30d-442f-a8cd-199ab25e4204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c436fcd5-c30d-442f-a8cd-199ab25e4204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b036cbe5-f796-4dd6-a887-596f00faa965', 'volume_name': 'volume-b036cbe5-f796-4dd6-a887-596f00faa965', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d753b5-fd37-4bbe-ba60-bbaa05a60fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d753b5-fd37-4bbe-ba60-bbaa05a60fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd81c8d-a1f5-4f7a-97c5-9fd6eaf6fed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Volume b036cbe5-f796-4dd6-a887-596f00faa965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b036cbe5-f796-4dd6-a887-596f00faa965', 'volume_size': 1} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "cinder-quobyte-f98b11be-a383-4306-90e7-0dda1bed9ea5" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-f98b11be-a383-4306-90e7-0dda1bed9ea5" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5253c29-8e3e-4a02-8e58-71a9a205f116]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:09 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844" returned: 0 in 0.435s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.856s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013499010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a75dd0-f157-4d53-a061-aa759dd83360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:08Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Creating volume f5a75dd0-f157-4d53-a061-aa759dd83360 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:09 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:09 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360 1073741824 Sep 25 16:27:09 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6c3eda-778f-48b8-bff8-81673b5fa98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d10b87-6c7a-4c65-9892-57f75d959844', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d5f4e9-c8df-42a4-ac84-8cd1800d96e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Volume volume-00d10b87-6c7a-4c65-9892-57f75d959844 (00d10b87-6c7a-4c65-9892-57f75d959844): created successfully Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d5f4e9-c8df-42a4-ac84-8cd1800d96e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (0f3f26b1-50b5-4ada-81ef-9cd63caf4ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8c761050-3755-41b2-8c8e-e32de50e2627 tempest-CreateVolumesFromImageTest-129427107 None] Created volume successfully. Sep 25 16:27:10 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 Sep 25 16:27:10 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:10 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5" returned: 0 in 0.640s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:10 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5 Sep 25 16:27:10 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:10 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360 1073741824" returned: 0 in 0.669s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:10 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360 Sep 25 16:27:10 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:10 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f98b11be-a383-4306-90e7-0dda1bed9ea5" returned: 0 in 0.341s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-quobyte-f98b11be-a383-4306-90e7-0dda1bed9ea5" released by "delete_volume" :: held 1.101s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Created reservations ['794937ff-d97b-4c61-98e9-02be7a0989c5', 'c3e4997c-7f22-4c7f-b784-c9cc3cda7c86', '8046d7b9-4e74-4242-a624-d8c4186a57ee', 'b2aebb9f-c650-4c58-b8a3-971c4d61f870'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:10 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.104s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344483911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f10809e-5141-4b74-bb78-02e67630c930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:09Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Creating volume 0f10809e-5141-4b74-bb78-02e67630c930 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:11 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930 1073741824 Sep 25 16:27:11 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec85aab-5512-4e41-8bbf-cc68a3577132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a75dd0-f157-4d53-a061-aa759dd83360', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f286e370-6b2b-43be-9293-2e184fe786c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:11 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:11 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Volume volume-f5a75dd0-f157-4d53-a061-aa759dd83360 (f5a75dd0-f157-4d53-a061-aa759dd83360): created successfully Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f286e370-6b2b-43be-9293-2e184fe786c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (4c3fef6f-ad88-4690-bc1d-af46e8421282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-db14f959-0b45-4167-8746-e28acb3f25a1 tempest-CreateVolumesFromImageTest-129427107 None] Created volume successfully. Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Flow 'volume_create_manager' (fe33fb82-e12e-4d68-8035-a1e27baef887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2201f4-454f-4b5a-8834-600d23ca15ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2201f4-454f-4b5a-8834-600d23ca15ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-608539421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569f325b-453b-4c32-a5d7-bf9d4e08ed8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298019c1fc32407d8b8b9ab4db23636a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:11Z,use_quota=True,user_id='b8c7f26c32d24dcd9a597b936b510b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d43ed37-d344-4d46-8074-eb7ef1436670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d43ed37-d344-4d46-8074-eb7ef1436670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb15ff3-ae74-495f-8c10-2ab68bec78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb15ff3-ae74-495f-8c10-2ab68bec78c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569f325b-453b-4c32-a5d7-bf9d4e08ed8b', 'volume_name': 'volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f922d1-ca96-4e21-a8b6-3a49cb5abc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f922d1-ca96-4e21-a8b6-3a49cb5abc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9023eed3-d4a7-4114-811a-e5d044746fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Volume 569f325b-453b-4c32-a5d7-bf9d4e08ed8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b', 'volume_size': 1} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:11 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.392s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Deleted volume successfully. Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-005d073e-e87c-4177-9a86-4225e2f41637 tempest-CreateVolumesFromSnapshotTest-210769379 None] Lock "cinder-f98b11be-a383-4306-90e7-0dda1bed9ea5-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:11 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930 1073741824" returned: 0 in 0.757s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:11 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930 Sep 25 16:27:11 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Flow 'volume_create_manager' (c0e01281-d656-4973-ba48-265d0de919e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:12 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85114ee-1c0d-4a4c-ba2e-10db2e388ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.459s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1253389087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b036cbe5-f796-4dd6-a887-596f00faa965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff039e8bb774552a547339701b6109c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:09Z,use_quota=True,user_id='3b2b2ed0eed848b8a0007c27f11ca220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Creating volume b036cbe5-f796-4dd6-a887-596f00faa965 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:12 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85114ee-1c0d-4a4c-ba2e-10db2e388ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664ecf0e-6e47-4ac3-891e-d2a25d40a66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7cf33f2fa448e591c44416698eeb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:12Z,use_quota=True,user_id='89ef3519a2294a58b4d03993045a85f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745aee65-57bd-4f1e-8dc7-bae008835905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:12 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965 1073741824 Sep 25 16:27:12 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745aee65-57bd-4f1e-8dc7-bae008835905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bef45e-e0ff-4216-a699-3bd5edc36611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3300b3e8-da9c-4738-ab2e-7cad03968e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f10809e-5141-4b74-bb78-02e67630c930', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3fc363-f1da-4c5e-ae08-fe4e0e795772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Volume volume-0f10809e-5141-4b74-bb78-02e67630c930 (0f10809e-5141-4b74-bb78-02e67630c930): created successfully Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3fc363-f1da-4c5e-ae08-fe4e0e795772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (c9461d4b-f13e-4477-8618-eed63e246aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-672733a8-defc-4d39-b773-7dd7cf23f0f6 tempest-CreateVolumesFromImageTest-129427107 None] Created volume successfully. Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bef45e-e0ff-4216-a699-3bd5edc36611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '664ecf0e-6e47-4ac3-891e-d2a25d40a66d', 'volume_name': 'volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d', 'volume_size': 1, 'image_id': 'ea0171fd-de7a-4e8c-b037-518184937551', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea0171fd-de7a-4e8c-b037-518184937551', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97f25fc2fd3e684d974520593350188e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a7cf33f2fa448e591c44416698eeb23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7ab4d607a2ee5e5f7b49609a93ed0b79f7d8c327988208242e8c6903865463d0654df44e41208e383268411353d0212b85855ff6b87da9124ed5ea2d56d14b0', 'id': 'ea0171fd-de7a-4e8c-b037-518184937551', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea0171fd-de7a-4e8c-b037-518184937551/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3af0408-9ac0-4e89-a9a7-6c62c00a4af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3af0408-9ac0-4e89-a9a7-6c62c00a4af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9963ad57-f5b2-4589-b0bc-f792099828a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Volume 664ecf0e-6e47-4ac3-891e-d2a25d40a66d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d', 'volume_size': 1, 'image_id': 'ea0171fd-de7a-4e8c-b037-518184937551', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea0171fd-de7a-4e8c-b037-518184937551', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97f25fc2fd3e684d974520593350188e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a7cf33f2fa448e591c44416698eeb23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7ab4d607a2ee5e5f7b49609a93ed0b79f7d8c327988208242e8c6903865463d0654df44e41208e383268411353d0212b85855ff6b87da9124ed5ea2d56d14b0', 'id': 'ea0171fd-de7a-4e8c-b037-518184937551', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea0171fd-de7a-4e8c-b037-518184937551/file', 'properties': {}}, 'image_service': } Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Trying to clone 664ecf0e-6e47-4ac3-891e-d2a25d40a66d from image ea0171fd-de7a-4e8c-b037-518184937551 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea0171fd-de7a-4e8c-b037-518184937551', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:27:12 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965 1073741824" returned: 0 in 0.571s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:27:12 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:12 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965 Sep 25 16:27:12 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f9112c-9333-4ca0-ac6d-4ee800eb67dc]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:12 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD Sep 25 16:27:12 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:13 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965" returned: 0 in 0.303s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.698s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-608539421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569f325b-453b-4c32-a5d7-bf9d4e08ed8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298019c1fc32407d8b8b9ab4db23636a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:11Z,use_quota=True,user_id='b8c7f26c32d24dcd9a597b936b510b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Creating volume 569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:13 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd81c8d-a1f5-4f7a-97c5-9fd6eaf6fed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b036cbe5-f796-4dd6-a887-596f00faa965', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01edd98-47c4-4f8b-b6d9-8e771715e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:13 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b 1073741824 Sep 25 16:27:13 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Volume volume-b036cbe5-f796-4dd6-a887-596f00faa965 (b036cbe5-f796-4dd6-a887-596f00faa965): created successfully Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01edd98-47c4-4f8b-b6d9-8e771715e956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Flow 'volume_create_manager' (8352828a-1845-4099-b462-d00ac57102db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-81095fce-dfe8-4148-9fb2-7c9770d87c37 tempest-CreateVolumesFromImageTest-129427107 None] Created volume successfully. Sep 25 16:27:13 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:13 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD Sep 25 16:27:13 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:13 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b 1073741824" returned: 0 in 0.555s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:13 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD" returned: 1 in 0.468s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Temporary image ea0171fd-de7a-4e8c-b037-518184937551 is fetched for user 89ef3519a2294a58b4d03993045a85f9. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1461}} Sep 25 16:27:13 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b Sep 25 16:27:13 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-b036cbe5-f796-4dd6-a887-596f00faa965-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[43abd051-de30-4fc3-a7f1-862c387a7bf1]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-b036cbe5-f796-4dd6-a887-596f00faa965-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-quobyte-b036cbe5-f796-4dd6-a887-596f00faa965" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-b036cbe5-f796-4dd6-a887-596f00faa965" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ed5bc4-d0c1-49b7-850a-d1b3f110fb50]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:13 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" returned: 0 in 0.322s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:14 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD Sep 25 16:27:14 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9023eed3-d4a7-4114-811a-e5d044746fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98ceb3b-b391-43c4-bf78-3bd136abefed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Volume volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b (569f325b-453b-4c32-a5d7-bf9d4e08ed8b): created successfully Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98ceb3b-b391-43c4-bf78-3bd136abefed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Flow 'volume_create_manager' (fe33fb82-e12e-4d68-8035-a1e27baef887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6cb3efce-c1e5-4401-afa6-84f4671bc50d tempest-SnapshotDependencyTests-2116717040 None] Created volume successfully. Sep 25 16:27:14 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965 Sep 25 16:27:14 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:14 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:14 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD Sep 25 16:27:14 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:14 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965" returned: 0 in 0.498s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:14 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965 Sep 25 16:27:14 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:14 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD" returned: 1 in 0.503s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664ecf0e-6e47-4ac3-891e-d2a25d40a66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7cf33f2fa448e591c44416698eeb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:12Z,use_quota=True,user_id='89ef3519a2294a58b4d03993045a85f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Creating volume 664ecf0e-6e47-4ac3-891e-d2a25d40a66d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:14 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:14 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b036cbe5-f796-4dd6-a887-596f00faa965" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:14 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d 1073741824 Sep 25 16:27:14 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-b036cbe5-f796-4dd6-a887-596f00faa965" released by "delete_volume" :: held 0.948s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Created reservations ['f310c8e6-84c6-4191-ac4d-6f16a1f40953', '70eb3150-3e2d-4e5c-9b33-4202ddf2aa14', '91141115-624d-432e-9705-1a8562715c89', 'e4e11fb6-21c8-4dbc-a8cc-8db37d0e15e3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:15 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:15 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:15 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.345s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Deleted volume successfully. Sep 25 16:27:15 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d 1073741824" returned: 0 in 0.598s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63251c8a-1860-4bf8-87a3-721f8450b923 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-b036cbe5-f796-4dd6-a887-596f00faa965-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:15 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d Sep 25 16:27:15 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Flow 'volume_create_manager' (51d3a1a7-7703-4152-aace-4c83f9efbb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7380b34-0a5d-4053-8c03-f9eeebb4fcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7380b34-0a5d-4053-8c03-f9eeebb4fcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1965933844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cea9770-b742-40fb-bea5-08606f747390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369c042a47e4439c80866bb8d92487cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:16Z,use_quota=True,user_id='7ed63dfaa99a4f29a808f4889c61ce41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d274deb-4992-4921-bddb-7a5c56e23fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d274deb-4992-4921-bddb-7a5c56e23fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab64056-89ef-41fc-8f8a-a30ba8777632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab64056-89ef-41fc-8f8a-a30ba8777632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cea9770-b742-40fb-bea5-08606f747390', 'volume_name': 'volume-9cea9770-b742-40fb-bea5-08606f747390', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f715d14f-dd16-400b-b107-d6336c6d5198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f715d14f-dd16-400b-b107-d6336c6d5198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28563a4f-05da-4749-bf27-1b69d3522094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Volume 9cea9770-b742-40fb-bea5-08606f747390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cea9770-b742-40fb-bea5-08606f747390', 'volume_size': 1} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:15 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.847s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Creating offline snapshot 5e2b6a55-c4be-4eda-8635-8129af36bfb8 of volume 569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Attempting download of ea0171fd-de7a-4e8c-b037-518184937551 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea0171fd-de7a-4e8c-b037-518184937551', 'metadata': {}}])) to volume 664ecf0e-6e47-4ac3-891e-d2a25d40a66d. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2ba272-36e3-4d11-a029-d3dce018dedc]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdbebeb-de03-4486-ae23-48a41546c56e]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea0171fd-de7a-4e8c-b037-518184937551_k75anerz {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:15 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b Sep 25 16:27:15 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:15 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea0171fd-de7a-4e8c-b037-518184937551_k75anerz Sep 25 16:27:15 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-0f10809e-5141-4b74-bb78-02e67630c930-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-0f10809e-5141-4b74-bb78-02e67630c930-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:16 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea0171fd-de7a-4e8c-b037-518184937551_k75anerz" returned: 0 in 0.367s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea0171fd-de7a-4e8c-b037-518184937551_k75anerz {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-quobyte-0f10809e-5141-4b74-bb78-02e67630c930" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:16 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-0f10809e-5141-4b74-bb78-02e67630c930" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" returned: 0 in 0.482s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa6151a-353d-4fb6-b95c-7680d39dc28f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:16 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 1G Sep 25 16:27:16 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:16 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea0171fd-de7a-4e8c-b037-518184937551_k75anerz Sep 25 16:27:16 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:16 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930 Sep 25 16:27:16 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:16 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea0171fd-de7a-4e8c-b037-518184937551_k75anerz" returned: 1 in 0.356s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea0171fd-de7a-4e8c-b037-518184937551_k75anerz' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[98377e90-60a6-470e-abab-bc544c9d38d9]: (4, 'raw') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:16 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:16 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 1G" returned: 0 in 0.432s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:16 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD Sep 25 16:27:16 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:16 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930 Sep 25 16:27:16 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:16 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 Sep 25 16:27:16 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:16 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:16 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0f10809e-5141-4b74-bb78-02e67630c930" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-0f10809e-5141-4b74-bb78-02e67630c930" released by "delete_volume" :: held 0.741s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Created reservations ['2ba1aec1-6a54-436a-9b78-14b504dc9d23', 'f27d0c7c-2970-4362-8bfc-816ec34157af', '208d624d-f970-4451-8ca8-b02a9cd56715', '61988a8d-9a42-411c-aebd-41b2e0ec06e3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:17 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:17 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 is being set with open permissions: ugo+rw Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:17 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 Sep 25 16:27:17 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:17 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD Sep 25 16:27:17 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:17 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:17 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-f5a75dd0-f157-4d53-a061-aa759dd83360-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:17 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-f5a75dd0-f157-4d53-a061-aa759dd83360-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:17 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] ea0171fd-de7a-4e8c-b037-518184937551 was raw, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1150}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:17 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d Sep 25 16:27:17 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:17 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.info Sep 25 16:27:17 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.329s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-quobyte-f5a75dd0-f157-4d53-a061-aa759dd83360" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Deleted volume successfully. Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-f5a75dd0-f157-4d53-a061-aa759dd83360" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98874801-9b45-4a65-878b-07d4062968ba tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-0f10809e-5141-4b74-bb78-02e67630c930-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dc0c88-5df4-4fb1-bbda-47fd131f3c62]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:17 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360 Sep 25 16:27:17 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:17 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.info" returned: 0 in 0.285s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:17 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.info is being set with open permissions: ugo+rw Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:17 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.info Sep 25 16:27:17 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:17 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360" returned: 0 in 0.422s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:17 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.info" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:17 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360 Sep 25 16:27:17 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.368s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1965933844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cea9770-b742-40fb-bea5-08606f747390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369c042a47e4439c80866bb8d92487cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:16Z,use_quota=True,user_id='7ed63dfaa99a4f29a808f4889c61ce41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Creating volume 9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:18 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d" returned: 0 in 0.604s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea0171fd-de7a-4e8c-b037-518184937551_o83gkhizdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:27:18 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:18 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 1073741824 Sep 25 16:27:18 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:18 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d 1G Sep 25 16:27:18 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d92b1825-a822-4db5-8e77-8f2e7c439733 tempest-SnapshotDependencyTests-2116717040 None] Create snapshot completed successfully Sep 25 16:27:18 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f5a75dd0-f157-4d53-a061-aa759dd83360" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-f5a75dd0-f157-4d53-a061-aa759dd83360" released by "delete_volume" :: held 0.749s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Created reservations ['f7b951d5-a868-4fba-94d9-d509369c45ed', '5c7ba21e-7de1-42b2-a7db-dfe264a940b4', 'f9547413-3ab8-4211-bd7b-f8495fd2753a', 'a41c11cf-bca6-4193-b6b1-de48043059fd'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:18 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d 1G" returned: 0 in 0.357s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Downloaded image ea0171fd-de7a-4e8c-b037-518184937551 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea0171fd-de7a-4e8c-b037-518184937551', 'metadata': {}}])) to volume 664ecf0e-6e47-4ac3-891e-d2a25d40a66d successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Temporary image ea0171fd-de7a-4e8c-b037-518184937551 for user 89ef3519a2294a58b4d03993045a85f9 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1465}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Marking volume 664ecf0e-6e47-4ac3-891e-d2a25d40a66d as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Copying metadata from image ea0171fd-de7a-4e8c-b037-518184937551 to 664ecf0e-6e47-4ac3-891e-d2a25d40a66d. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Creating volume glance metadata for volume 664ecf0e-6e47-4ac3-891e-d2a25d40a66d backed by image ea0171fd-de7a-4e8c-b037-518184937551 with: {'image_id': 'ea0171fd-de7a-4e8c-b037-518184937551', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '97f25fc2fd3e684d974520593350188e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:27:18 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:18 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9963ad57-f5b2-4589-b0bc-f792099828a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d', 'volume_size': 1, 'image_id': 'ea0171fd-de7a-4e8c-b037-518184937551', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea0171fd-de7a-4e8c-b037-518184937551', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97f25fc2fd3e684d974520593350188e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a7cf33f2fa448e591c44416698eeb23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7ab4d607a2ee5e5f7b49609a93ed0b79f7d8c327988208242e8c6903865463d0654df44e41208e383268411353d0212b85855ff6b87da9124ed5ea2d56d14b0', 'id': 'ea0171fd-de7a-4e8c-b037-518184937551', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea0171fd-de7a-4e8c-b037-518184937551/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c28210-88e9-44ec-8275-558fdccd7e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-00d10b87-6c7a-4c65-9892-57f75d959844-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:18 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Volume volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d (664ecf0e-6e47-4ac3-891e-d2a25d40a66d): created successfully Sep 25 16:27:18 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c28210-88e9-44ec-8275-558fdccd7e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Flow 'volume_create_manager' (c0e01281-d656-4973-ba48-265d0de919e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 1073741824" returned: 0 in 0.577s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-00d10b87-6c7a-4c65-9892-57f75d959844-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5ba9fff7-f02d-4258-bb49-15fa182b048d tempest-VolumeImageDependencyTests-198030469 None] Created volume successfully. Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-quobyte-00d10b87-6c7a-4c65-9892-57f75d959844" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-00d10b87-6c7a-4c65-9892-57f75d959844" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:18 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:18 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 Sep 25 16:27:18 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Deleted volume successfully. Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0710170-fc51-4b80-92e0-bdec31b39923]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e5422b51-602b-4caa-8f44-e735450ee481 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-f5a75dd0-f157-4d53-a061-aa759dd83360-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:18 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844 Sep 25 16:27:18 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:18 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28563a4f-05da-4749-bf27-1b69d3522094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cea9770-b742-40fb-bea5-08606f747390', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcc7889-c47b-4010-87f0-4f98910df6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:18 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Volume volume-9cea9770-b742-40fb-bea5-08606f747390 (9cea9770-b742-40fb-bea5-08606f747390): created successfully Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcc7889-c47b-4010-87f0-4f98910df6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Flow 'volume_create_manager' (51d3a1a7-7703-4152-aace-4c83f9efbb3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3e56dc30-da48-4ca5-8d46-00e68f4915c5 tempest-VolumeDependencyTests-1805109206 None] Created volume successfully. Sep 25 16:27:19 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:19 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844 Sep 25 16:27:19 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:19 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00d10b87-6c7a-4c65-9892-57f75d959844" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-00d10b87-6c7a-4c65-9892-57f75d959844" released by "delete_volume" :: held 0.760s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Created reservations ['7da10f18-96d9-4fb6-b754-dbfd3ecde91b', 'f56ab839-200b-446b-8ff9-2be4014ad2ec', '8d0767b7-294d-4846-89ac-53b2a2a455fb', '1b687f7b-db77-4ca6-91f1-2a9269241550'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Acquiring lock "cinder-664ecf0e-6e47-4ac3-891e-d2a25d40a66d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Lock "cinder-664ecf0e-6e47-4ac3-891e-d2a25d40a66d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:19 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:19 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Acquiring lock "cinder-quobyte-664ecf0e-6e47-4ac3-891e-d2a25d40a66d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-ff6154c5-708d-4a42-9253-b244ca9660bc-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-ff6154c5-708d-4a42-9253-b244ca9660bc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Lock "cinder-quobyte-664ecf0e-6e47-4ac3-891e-d2a25d40a66d" acquired by "delete_volume" :: waited 0.068s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Flow 'volume_create_manager' (ba6b9d0a-2572-4cb5-bc27-0f872a26d90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5b7b8c-9c51-480b-b6c1-bd122290a02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76205d0-a4d6-4d69-a602-f9aee2d96167]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5b7b8c-9c51-480b-b6c1-bd122290a02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298019c1fc32407d8b8b9ab4db23636a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5e2b6a55-c4be-4eda-8635-8129af36bfb8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:20Z,use_quota=True,user_id='b8c7f26c32d24dcd9a597b936b510b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcd923b-adb1-4d67-92b6-f865fc9cc4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcd923b-adb1-4d67-92b6-f865fc9cc4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4a35f1-74d4-4736-a198-9a264e83dba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4a35f1-74d4-4736-a198-9a264e83dba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5', 'volume_name': 'volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5', 'volume_size': 1, 'snapshot_id': '5e2b6a55-c4be-4eda-8635-8129af36bfb8'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c85a725-6141-4b83-bb98-1a282f036486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c85a725-6141-4b83-bb98-1a282f036486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa30170b-a02b-492d-8df6-9d87137ef6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Volume 8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5', 'volume_size': 1, 'snapshot_id': '5e2b6a55-c4be-4eda-8635-8129af36bfb8'} Sep 25 16:27:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "cinder-quobyte-ff6154c5-708d-4a42-9253-b244ca9660bc" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "cinder-quobyte-5e2b6a55-c4be-4eda-8635-8129af36bfb8-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:20 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.358s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-ff6154c5-708d-4a42-9253-b244ca9660bc" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Deleted volume successfully. Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-5e2b6a55-c4be-4eda-8635-8129af36bfb8-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Creating volume 8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 from snapshot 5e2b6a55-c4be-4eda-8635-8129af36bfb8 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "cinder-quobyte-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e650b35-c003-4b8d-b3da-6de2c2b7893d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:20 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d Sep 25 16:27:20 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4e0ea5af-d61f-4e07-b3c5-328166823761 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-00d10b87-6c7a-4c65-9892-57f75d959844-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] snapshot: 5e2b6a55-c4be-4eda-8635-8129af36bfb8, volume: 8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[13916d00-4ed4-4ebc-a746-561fe7378433]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:20 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc Sep 25 16:27:20 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:20 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 Sep 25 16:27:20 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:20 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d" returned: 0 in 0.503s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:20 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d Sep 25 16:27:20 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:20 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc" returned: 0 in 0.442s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:20 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc Sep 25 16:27:20 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:20 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8" returned: 0 in 0.439s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05272bd-2f82-4239-85ef-a554c2e77200]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:20 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-664ecf0e-6e47-4ac3-891e-d2a25d40a66d" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Lock "cinder-quobyte-664ecf0e-6e47-4ac3-891e-d2a25d40a66d" released by "delete_volume" :: held 0.941s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:20 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b Sep 25 16:27:20 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Created reservations ['7afa4e19-e7da-4422-afc4-f346864e92c7', '8604ad67-abd9-4b18-9268-b5dd64544a02', '0f9c33c2-ab6e-465a-8bc5-1fef6c7e5e28', 'f4a0eb06-423d-4302-9833-514fa19c0f2e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:20 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-ff6154c5-708d-4a42-9253-b244ca9660bc" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-quobyte-ff6154c5-708d-4a42-9253-b244ca9660bc" released by "delete_volume" :: held 0.824s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Created reservations ['0ad04cf8-d1ca-4350-8e7d-9b11efd80bb2', 'b4ae9c8f-e5c6-45cd-8fd7-42e27274cd0f', 'd431ab6c-159f-46cb-99bd-d024978d67bb', '479b15a4-7277-40ab-81c8-9e74150300ed'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:20 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:20 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:21 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:21 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:21 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" returned: 0 in 0.454s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:21 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 Sep 25 16:27:21 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:21 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.306s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Deleted volume successfully. Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fecd1dc9-ec24-4161-8aad-56abfe645f5d tempest-VolumeImageDependencyTests-198030469 None] Lock "cinder-664ecf0e-6e47-4ac3-891e-d2a25d40a66d-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:21 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Deleted volume successfully. Sep 25 16:27:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-854d611a-8aae-4df6-bf5a-fe66041a2c76 tempest-CreateVolumesFromImageTest-129427107 None] Lock "cinder-ff6154c5-708d-4a42-9253-b244ca9660bc-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:29 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" returned: 0 in 8.015s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:27:29 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Converted 1024.00 MB image at 127.74 MB/s Sep 25 16:27:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 is being set with open permissions: ugo+rw Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:29 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 Sep 25 16:27:29 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:29 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" released by "_copy_volume_from_snapshot" :: held 9.304s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-5e2b6a55-c4be-4eda-8635-8129af36bfb8-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" released by "_create_volume_from_snapshot" :: held 9.478s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.535s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.355s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Creating offline snapshot f845749a-1590-49a5-8423-56e069d7923b of volume 9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e186114-9673-4d0c-9a78-e24a194eabd8]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa30170b-a02b-492d-8df6-9d87137ef6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5', 'volume_size': 1, 'snapshot_id': '5e2b6a55-c4be-4eda-8635-8129af36bfb8'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcc8acd-d60b-4b4a-aa73-df67efeb4397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Volume volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 (8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5): created successfully Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcc8acd-d60b-4b4a-aa73-df67efeb4397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Flow 'volume_create_manager' (ba6b9d0a-2572-4cb5-bc27-0f872a26d90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Flow 'volume_create_manager' (35584cd5-76de-4482-acc7-e616a1686f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:29 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 Sep 25 16:27:29 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50c59bb-a397-4f2e-a950-34257e0e6e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50c59bb-a397-4f2e-a950-34257e0e6e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4ef412-da52-4f85-ae2c-00ac6be68d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c52b33a6bf4a8d874dd5003f5710f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:30Z,use_quota=True,user_id='ae80586282304c848c26a828f89660b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec282a8a-01d6-4fc7-9eb2-44ff97ec5283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec282a8a-01d6-4fc7-9eb2-44ff97ec5283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ace822-e264-446a-990b-5df7f3206072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ace822-e264-446a-990b-5df7f3206072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4ef412-da52-4f85-ae2c-00ac6be68d7f', 'volume_name': 'volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068f601c-e29c-4e9f-a0ad-27fce189d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068f601c-e29c-4e9f-a0ad-27fce189d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b1e03b-5638-4fef-a6a0-690ad6709c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Volume 4d4ef412-da52-4f85-ae2c-00ac6be68d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f', 'volume_size': 1} Sep 25 16:27:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-54c14563-a80b-4076-96bc-d306de36c903 tempest-SnapshotDependencyTests-2116717040 None] Created volume successfully. Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "cinder-5e2b6a55-c4be-4eda-8635-8129af36bfb8-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-5e2b6a55-c4be-4eda-8635-8129af36bfb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "cinder-quobyte-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "cinder-quobyte-5e2b6a55-c4be-4eda-8635-8129af36bfb8" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-5e2b6a55-c4be-4eda-8635-8129af36bfb8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Deleting offline snapshot 5e2b6a55-c4be-4eda-8635-8129af36bfb8 of volume 569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:27:30 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] snapshot_file for this snap is: volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390" returned: 0 in 0.499s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4068ee2-d4ef-41be-bfe7-b5aa513ee21b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:30 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b 1G Sep 25 16:27:30 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:30 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 Sep 25 16:27:30 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:30 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8" returned: 0 in 0.420s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[584e2c1f-ef3d-4957-a442-edfae65a5090]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:30 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b 1G" returned: 0 in 0.475s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cea9770-b742-40fb-bea5-08606f747390 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:30 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cea9770-b742-40fb-bea5-08606f747390 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b Sep 25 16:27:30 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:30 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b Sep 25 16:27:30 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:30 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cea9770-b742-40fb-bea5-08606f747390 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b" returned: 0 in 0.326s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:30 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b is being set with open permissions: ugo+rw Sep 25 16:27:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:30 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b Sep 25 16:27:30 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:31 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" returned: 0 in 0.583s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:31 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:31 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 Sep 25 16:27:31 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:31 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:31 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8 Sep 25 16:27:31 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:31 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b.5e2b6a55-c4be-4eda-8635-8129af36bfb8" returned: 0 in 0.235s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-5e2b6a55-c4be-4eda-8635-8129af36bfb8" released by "_delete_snapshot" :: held 2.800s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" released by "delete_snapshot" :: held 2.828s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:32 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=169,cinder:INSERT=62,cinder:UPDATE=230,cinder:DELETE=25 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Created reservations ['5efe1c37-89db-4ac1-ae9d-e17cb65c1ee0', 'f1bf0f33-11a4-4fd1-92b1-7615ae9c1238', 'c11a0e6e-cb74-4aba-892e-051ea61d39e0', '7463d1d1-0fac-4f14-b25f-07e0b74bcc5a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=177,cinder:UPDATE=234,cinder:DELETE=18,cinder:INSERT=66 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:27:36 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.info Sep 25 16:27:36 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Delete snapshot completed successfully. Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-836b29c2-b5fa-4fd7-89bd-497dd930b91e tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-5e2b6a55-c4be-4eda-8635-8129af36bfb8-delete_snapshot" released by "delete_snapshot" :: held 6.357s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:36 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.info" returned: 0 in 0.329s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:36 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.info is being set with open permissions: ugo+rw Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:36 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.info Sep 25 16:27:36 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "cinder-569f325b-453b-4c32-a5d7-bf9d4e08ed8b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-569f325b-453b-4c32-a5d7-bf9d4e08ed8b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "cinder-quobyte-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[02af1af1-f878-46aa-93ec-617882f38b52]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:36 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.info" returned: 0 in 0.325s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.370s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.128s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4ef412-da52-4f85-ae2c-00ac6be68d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c52b33a6bf4a8d874dd5003f5710f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:30Z,use_quota=True,user_id='ae80586282304c848c26a828f89660b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Creating volume 4d4ef412-da52-4f85-ae2c-00ac6be68d7f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:36 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b Sep 25 16:27:36 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:36 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f 1073741824 Sep 25 16:27:36 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fdb1500a-efeb-4f32-8ce4-81a4ba8a8acb tempest-VolumeDependencyTests-1805109206 None] Create snapshot completed successfully Sep 25 16:27:37 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" returned: 0 in 0.497s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:37 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b Sep 25 16:27:37 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:37 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f 1073741824" returned: 0 in 0.610s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:37 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f Sep 25 16:27:37 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:37 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-569f325b-453b-4c32-a5d7-bf9d4e08ed8b" released by "delete_volume" :: held 0.926s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Created reservations ['1e07eff8-4b64-48a1-b061-910067dc494d', '382b2cb1-cba6-44b2-a3d3-ddef754e3079', '30e8a5cd-6663-4f40-95df-89e5e9b51cba', '3d215870-5577-480d-97b9-8f6e0056cf82'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:37 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f" returned: 0 in 0.375s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b1e03b-5638-4fef-a6a0-690ad6709c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f2712f-cad0-45e9-b014-a8e60d2d0adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:38 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:38 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:38 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Volume volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f (4d4ef412-da52-4f85-ae2c-00ac6be68d7f): created successfully Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f2712f-cad0-45e9-b014-a8e60d2d0adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Flow 'volume_create_manager' (35584cd5-76de-4482-acc7-e616a1686f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Flow 'volume_create_manager' (2c616510-0648-4e1e-80da-0d98b9a597d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8aac856-ad5f-4b39-a913-21dc73a0a7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4bafeb94-2cbb-4770-ad34-a4894a4ff22a tempest-CinderUnicodeTest-832196417 None] Created volume successfully. Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8aac856-ad5f-4b39-a913-21dc73a0a7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-685844281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e83b70-883c-4cda-a5ae-6cbc8e4d1426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369c042a47e4439c80866bb8d92487cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f845749a-1590-49a5-8423-56e069d7923b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:38Z,use_quota=True,user_id='7ed63dfaa99a4f29a808f4889c61ce41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd8857c-aca0-45af-976d-f138a9e8ac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd8857c-aca0-45af-976d-f138a9e8ac49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fca4cb0-0e59-4fa0-9de0-e0eb06f68d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fca4cb0-0e59-4fa0-9de0-e0eb06f68d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54e83b70-883c-4cda-a5ae-6cbc8e4d1426', 'volume_name': 'volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426', 'volume_size': 1, 'snapshot_id': 'f845749a-1590-49a5-8423-56e069d7923b'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0c9c4c-a420-4bdb-9716-886eeca110d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0c9c4c-a420-4bdb-9716-886eeca110d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8ae766-2846-4f30-bcd6-58c9ad3b17a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:38 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Volume 54e83b70-883c-4cda-a5ae-6cbc8e4d1426: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426', 'volume_size': 1, 'snapshot_id': 'f845749a-1590-49a5-8423-56e069d7923b'} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "cinder-quobyte-f845749a-1590-49a5-8423-56e069d7923b-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-f845749a-1590-49a5-8423-56e069d7923b-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Creating volume 54e83b70-883c-4cda-a5ae-6cbc8e4d1426 from snapshot f845749a-1590-49a5-8423-56e069d7923b {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "cinder-quobyte-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] snapshot: f845749a-1590-49a5-8423-56e069d7923b, volume: 54e83b70-883c-4cda-a5ae-6cbc8e4d1426, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec51e4b-996d-4380-9966-f84f355c96ae]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:38 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.374s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Deleted volume successfully. Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-14573b3a-a8d1-4793-8752-e497f930001f tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-569f325b-453b-4c32-a5d7-bf9d4e08ed8b-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:38 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b Sep 25 16:27:38 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:38 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b" returned: 0 in 0.419s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cea9770-b742-40fb-bea5-08606f747390(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6160a16-3087-4da1-b7e7-29907d64803b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:38 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 Sep 25 16:27:38 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "cinder-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "cinder-quobyte-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fce12e-c7c9-451c-bc25-fd12c7bc6cab]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:39 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 Sep 25 16:27:39 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:39 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390" returned: 0 in 0.558s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Path /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:39 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 Sep 25 16:27:39 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:39 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" returned: 0 in 0.420s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:39 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5 Sep 25 16:27:39 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:39 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Flow 'volume_create_manager' (8b423c83-e134-4c17-b0d5-acec99bb023c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719a3ae3-dccf-47bf-a575-d3e00cbebaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" returned: 0 in 0.346s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719a3ae3-dccf-47bf-a575-d3e00cbebaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-46071823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b55f4b5-d753-43e2-8dc5-46287d942109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c52b33a6bf4a8d874dd5003f5710f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:40Z,use_quota=True,user_id='ae80586282304c848c26a828f89660b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4b55db-f7b6-4929-b9ba-3f0f2fa00067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4b55db-f7b6-4929-b9ba-3f0f2fa00067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c2bbc0-9e8d-444a-8217-ddce07a9a35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c2bbc0-9e8d-444a-8217-ddce07a9a35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b55f4b5-d753-43e2-8dc5-46287d942109', 'volume_name': 'volume-4b55f4b5-d753-43e2-8dc5-46287d942109', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82749996-b81e-4e34-a208-9987df756d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82749996-b81e-4e34-a208-9987df756d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c4d86a-7f57-4a5b-a97c-9a99e17d565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Volume 4b55f4b5-d753-43e2-8dc5-46287d942109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b55f4b5-d753-43e2-8dc5-46287d942109', 'volume_size': 1} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-quobyte-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5" released by "delete_volume" :: held 0.887s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Created reservations ['58125e81-7a3b-442d-83f3-a45df8dabd6b', '3aed8a43-fc92-48ad-9c44-c6987d01b051', 'f72a3c70-d035-4787-992c-69de5c0d0e15', '399c91b7-0024-40a7-98f8-f6695593f2d4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:40 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:40 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:40 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.590s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Deleted volume successfully. Sep 25 16:27:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce642089-39ac-4447-aa5f-5a0dff878192 tempest-SnapshotDependencyTests-2116717040 None] Lock "cinder-8b7890a8-a3bb-44ea-9bf9-9ee4e84ab2d5-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:48 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" returned: 0 in 8.803s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Image conversion details: src /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390, size 1024.00 MB, duration 8.80 sec, destination /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:27:48 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Converted 1024.00 MB image at 116.30 MB/s Sep 25 16:27:48 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 is being set with open permissions: ugo+rw Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:48 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 Sep 25 16:27:48 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:48 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" returned: 0 in 0.322s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" released by "_copy_volume_from_snapshot" :: held 10.237s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-f845749a-1590-49a5-8423-56e069d7923b-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" released by "_create_volume_from_snapshot" :: held 10.322s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.342s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.579s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-46071823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b55f4b5-d753-43e2-8dc5-46287d942109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c52b33a6bf4a8d874dd5003f5710f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:40Z,use_quota=True,user_id='ae80586282304c848c26a828f89660b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Creating volume 4b55f4b5-d753-43e2-8dc5-46287d942109 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:48 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:48 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 1073741824 Sep 25 16:27:48 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8ae766-2846-4f30-bcd6-58c9ad3b17a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426', 'volume_size': 1, 'snapshot_id': 'f845749a-1590-49a5-8423-56e069d7923b'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bdf1f1-ec2e-4c2f-972d-815b3165ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Volume volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 (54e83b70-883c-4cda-a5ae-6cbc8e4d1426): created successfully Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bdf1f1-ec2e-4c2f-972d-815b3165ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Flow 'volume_create_manager' (2c616510-0648-4e1e-80da-0d98b9a597d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cd7a7aa7-6869-462c-9f8c-4484f93470f1 tempest-VolumeDependencyTests-1805109206 None] Created volume successfully. Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "cinder-f845749a-1590-49a5-8423-56e069d7923b-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-f845749a-1590-49a5-8423-56e069d7923b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "cinder-quobyte-9cea9770-b742-40fb-bea5-08606f747390" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-9cea9770-b742-40fb-bea5-08606f747390" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "cinder-quobyte-f845749a-1590-49a5-8423-56e069d7923b" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-f845749a-1590-49a5-8423-56e069d7923b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Deleting offline snapshot f845749a-1590-49a5-8423-56e069d7923b of volume 9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] snapshot_file for this snap is: volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8312bbf-0ea1-4938-bbc7-9920d64f0bc5]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:49 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 1073741824" returned: 0 in 0.724s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:49 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 Sep 25 16:27:49 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:49 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b Sep 25 16:27:49 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:49 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b" returned: 0 in 0.477s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cea9770-b742-40fb-bea5-08606f747390(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:27:49 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109" returned: 0 in 0.420s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfdf269-1c37-4295-889e-b490e3c8ac69]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c4d86a-7f57-4a5b-a97c-9a99e17d565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b55f4b5-d753-43e2-8dc5-46287d942109', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f6e0d8-4976-4717-a477-f02d190489cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:49 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Volume volume-4b55f4b5-d753-43e2-8dc5-46287d942109 (4b55f4b5-d753-43e2-8dc5-46287d942109): created successfully Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f6e0d8-4976-4717-a477-f02d190489cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Flow 'volume_create_manager' (8b423c83-e134-4c17-b0d5-acec99bb023c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-57643b4d-f127-4afa-b1e4-97cbd32e7ec9 tempest-CinderUnicodeTest-832196417 None] Created volume successfully. Sep 25 16:27:50 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 Sep 25 16:27:50 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Creating offline snapshot aae531c6-7d0a-48d9-b721-0ad07fd05713 of volume 4b55f4b5-d753-43e2-8dc5-46287d942109 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:27:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bc539e-4264-4752-9dea-bf938b708980]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:50 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390" returned: 0 in 0.840s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:50 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b Sep 25 16:27:50 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:50 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 Sep 25 16:27:50 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:51 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109" returned: 0 in 0.490s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:51 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:51 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 1G Sep 25 16:27:51 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b" returned: 0 in 0.436s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:51 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b Sep 25 16:27:51 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:51 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390.f845749a-1590-49a5-8423-56e069d7923b" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-f845749a-1590-49a5-8423-56e069d7923b" released by "_delete_snapshot" :: held 2.284s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-9cea9770-b742-40fb-bea5-08606f747390" released by "delete_snapshot" :: held 2.311s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Created reservations ['387c581a-4f35-42e4-b9d5-f09f63092e23', '02ab8a80-d8d9-45b2-9ad4-0c9583a9d287', 'c066819a-5be5-4bf1-ab17-fd9df6f820ca', '358b5ba3-a7cd-4522-9abf-d84047f9b3aa'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:51 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 1G" returned: 0 in 0.625s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b55f4b5-d753-43e2-8dc5-46287d942109 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Delete snapshot completed successfully. Sep 25 16:27:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a04d933c-e6b2-4d9a-abfb-89894c74ab77 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-f845749a-1590-49a5-8423-56e069d7923b-delete_snapshot" released by "delete_snapshot" :: held 2.552s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:51 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b55f4b5-d753-43e2-8dc5-46287d942109 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 Sep 25 16:27:51 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:52 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b55f4b5-d753-43e2-8dc5-46287d942109 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:52 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 is being set with open permissions: ugo+rw Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:52 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 Sep 25 16:27:52 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:52 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713" returned: 0 in 0.402s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "cinder-9cea9770-b742-40fb-bea5-08606f747390-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:52 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.info Sep 25 16:27:52 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-9cea9770-b742-40fb-bea5-08606f747390-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "cinder-quobyte-9cea9770-b742-40fb-bea5-08606f747390" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-9cea9770-b742-40fb-bea5-08606f747390" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e304b767-00c5-4580-bdc1-519f1f6f7471]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:52 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.info" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:52 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.info is being set with open permissions: ugo+rw Sep 25 16:27:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:52 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 Sep 25 16:27:52 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:52 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.info Sep 25 16:27:52 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:53 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.info" returned: 0 in 0.283s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:53 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.675s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390" returned: 0 in 0.440s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:53 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390 Sep 25 16:27:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-350ff2c7-25c0-4279-8c3c-e67e90ed3f31 tempest-CinderUnicodeTest-832196417 None] Create snapshot completed successfully Sep 25 16:27:53 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:53 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9cea9770-b742-40fb-bea5-08606f747390" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-9cea9770-b742-40fb-bea5-08606f747390" released by "delete_volume" :: held 0.846s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Created reservations ['895158d9-4a31-420c-8b1a-cfcb66875a6c', '17f51a30-cfdf-4117-8a10-4c0179e12b85', '83ab084f-d995-4434-a4de-52647b39a077', '13186de9-0169-4b2b-a5f9-47fbb5b7e835'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:53 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:53 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "cinder-54e83b70-883c-4cda-a5ae-6cbc8e4d1426-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Acquiring lock "cinder-aae531c6-7d0a-48d9-b721-0ad07fd05713-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-54e83b70-883c-4cda-a5ae-6cbc8e4d1426-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Lock "cinder-aae531c6-7d0a-48d9-b721-0ad07fd05713-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Acquiring lock "cinder-quobyte-4b55f4b5-d753-43e2-8dc5-46287d942109" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Lock "cinder-quobyte-4b55f4b5-d753-43e2-8dc5-46287d942109" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Acquiring lock "cinder-quobyte-aae531c6-7d0a-48d9-b721-0ad07fd05713" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "cinder-quobyte-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Lock "cinder-quobyte-aae531c6-7d0a-48d9-b721-0ad07fd05713" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:54 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Deleting offline snapshot aae531c6-7d0a-48d9-b721-0ad07fd05713 of volume 4b55f4b5-d753-43e2-8dc5-46287d942109 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] snapshot_file for this snap is: volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" acquired by "delete_volume" :: waited 0.066s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaa99b7-0d62-442b-8ef0-f7e9df450150]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.377s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Deleted volume successfully. Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c5d1c9-86ec-410c-a906-5080cf8b29f2]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b7343ffa-a193-4782-a134-33a193bf68f0 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-9cea9770-b742-40fb-bea5-08606f747390-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:54 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 Sep 25 16:27:54 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:54 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 Sep 25 16:27:54 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:54 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" returned: 0 in 0.565s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:54 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713" returned: 0 in 0.614s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b55f4b5-d753-43e2-8dc5-46287d942109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:27:54 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426 Sep 25 16:27:54 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342b5a0-7cb9-4f9f-9171-d51bdcd0d9c9]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:55 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 Sep 25 16:27:55 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:55 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" returned: 0 in 0.482s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-quobyte-54e83b70-883c-4cda-a5ae-6cbc8e4d1426" released by "delete_volume" :: held 1.127s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Created reservations ['4edeff7b-896e-401b-bc47-33475530fad9', 'f2d3fd8f-42be-4879-a8ad-8508e3b29e97', '43b8f649-061e-47cc-9603-a0c7c249f61f', '20c279b8-cd8b-4f6a-b55a-1366814a10a6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:55 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109" returned: 0 in 0.654s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:55 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 Sep 25 16:27:55 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:55 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:55 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Flow 'volume_create_manager' (d352d38d-267a-4042-af6a-2024c2fc6b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82a43f1-3a53-4a3b-a0d6-33beeee27eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82a43f1-3a53-4a3b-a0d6-33beeee27eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306238243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84db10ae-987d-467b-a627-2dade69fb2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031ad947e06641c2bfa7070f78f4d9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:56Z,use_quota=True,user_id='e1abb67d63414b68835cfddf1a5500ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50387db0-1908-4661-b5e9-03e5340dfd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50387db0-1908-4661-b5e9-03e5340dfd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a656f78a-f090-4d23-a28b-2f67947d821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a656f78a-f090-4d23-a28b-2f67947d821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84db10ae-987d-467b-a627-2dade69fb2ca', 'volume_name': 'volume-84db10ae-987d-467b-a627-2dade69fb2ca', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b839fb-4f58-4963-9bf1-56beb33c13ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b839fb-4f58-4963-9bf1-56beb33c13ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5d8038-8425-41b9-8c3d-7dc065589ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:55 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Volume 84db10ae-987d-467b-a627-2dade69fb2ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84db10ae-987d-467b-a627-2dade69fb2ca', 'volume_size': 1} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306238243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84db10ae-987d-467b-a627-2dade69fb2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031ad947e06641c2bfa7070f78f4d9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:56Z,use_quota=True,user_id='e1abb67d63414b68835cfddf1a5500ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Creating volume 84db10ae-987d-467b-a627-2dade69fb2ca {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:55 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:55 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca 1073741824 Sep 25 16:27:55 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:55 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.326s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:55 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Deleted volume successfully. Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fec5236a-75a8-4b59-935d-e9a63bb48a93 tempest-VolumeDependencyTests-1805109206 None] Lock "cinder-54e83b70-883c-4cda-a5ae-6cbc8e4d1426-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:56 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713" returned: 0 in 0.503s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:56 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713 Sep 25 16:27:56 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:56 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109.aae531c6-7d0a-48d9-b721-0ad07fd05713" returned: 0 in 0.340s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:56 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca 1073741824" returned: 0 in 0.608s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Lock "cinder-quobyte-aae531c6-7d0a-48d9-b721-0ad07fd05713" released by "_delete_snapshot" :: held 2.318s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Lock "cinder-quobyte-4b55f4b5-d753-43e2-8dc5-46287d942109" released by "delete_snapshot" :: held 2.412s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:56 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca Sep 25 16:27:56 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Created reservations ['016a1133-cfb0-4405-9ddc-f24a8a80a9e6', '97b87171-9444-400f-8c67-5fe957ca0a00', '65c8906e-9e9c-417f-a779-55405d475114', 'c58b6c85-7bd5-4943-892c-727dffa515f0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Delete snapshot completed successfully. Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4206a9f0-fd13-409b-af2b-3a296ca12e13 tempest-CinderUnicodeTest-832196417 None] Lock "cinder-aae531c6-7d0a-48d9-b721-0ad07fd05713-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:56 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca" returned: 0 in 0.386s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5d8038-8425-41b9-8c3d-7dc065589ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84db10ae-987d-467b-a627-2dade69fb2ca', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8b2cf5-1eae-491d-adfe-3a17c84dba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Volume volume-84db10ae-987d-467b-a627-2dade69fb2ca (84db10ae-987d-467b-a627-2dade69fb2ca): created successfully Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8b2cf5-1eae-491d-adfe-3a17c84dba4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Flow 'volume_create_manager' (d352d38d-267a-4042-af6a-2024c2fc6b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-09e3a3e8-ec8b-4ba2-bdf8-00a02719e318 tempest-ProjectReaderTests-1798695758 None] Created volume successfully. Sep 25 16:27:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Acquiring lock "cinder-4b55f4b5-d753-43e2-8dc5-46287d942109-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Lock "cinder-4b55f4b5-d753-43e2-8dc5-46287d942109-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Acquiring lock "cinder-quobyte-4b55f4b5-d753-43e2-8dc5-46287d942109" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Lock "cinder-quobyte-4b55f4b5-d753-43e2-8dc5-46287d942109" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[650de1fd-c3ce-4bec-81f7-a7e29e997e94]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:57 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 Sep 25 16:27:57 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:57 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109" returned: 0 in 0.514s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109 Sep 25 16:27:58 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Acquiring lock "cinder-84db10ae-987d-467b-a627-2dade69fb2ca-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:58 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4b55f4b5-d753-43e2-8dc5-46287d942109" returned: 0 in 0.301s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Lock "cinder-84db10ae-987d-467b-a627-2dade69fb2ca-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Lock "cinder-quobyte-4b55f4b5-d753-43e2-8dc5-46287d942109" released by "delete_volume" :: held 0.959s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Acquiring lock "cinder-quobyte-84db10ae-987d-467b-a627-2dade69fb2ca" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Lock "cinder-quobyte-84db10ae-987d-467b-a627-2dade69fb2ca" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d8ed7e-9b27-4216-a841-2d1fb1de93b8]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Created reservations ['9d73f59e-6da4-4f91-9340-a2020cdbc7cc', '3d00517c-e8ba-4316-89e4-a457397035c1', '92282c73-0c84-4fee-a8dd-e69c08f11300', '5481d95c-fc76-4d4e-86ec-9c5f1181228d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:58 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca Sep 25 16:27:58 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:58 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:58 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:58 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Deleted volume successfully. Sep 25 16:27:58 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32649d6f-03ac-40d9-ae7e-17fd628a7d6e tempest-CinderUnicodeTest-832196417 None] Lock "cinder-4b55f4b5-d753-43e2-8dc5-46287d942109-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca" returned: 0 in 0.456s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:58 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca Sep 25 16:27:58 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:27:59 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-84db10ae-987d-467b-a627-2dade69fb2ca" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Lock "cinder-quobyte-84db10ae-987d-467b-a627-2dade69fb2ca" released by "delete_volume" :: held 0.781s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Created reservations ['2d9b49d2-83ab-441c-83f8-dda4bd8457af', '7566ce3a-e987-4a67-89d2-2240ababc595', '231f303a-e024-4963-8aaf-04eba0cdaf0e', '7bba79f9-0d3d-4b2c-bbe4-03d597bb166f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:59 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:27:59 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Acquiring lock "cinder-4d4ef412-da52-4f85-ae2c-00ac6be68d7f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Lock "cinder-4d4ef412-da52-4f85-ae2c-00ac6be68d7f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Acquiring lock "cinder-quobyte-4d4ef412-da52-4f85-ae2c-00ac6be68d7f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Lock "cinder-quobyte-4d4ef412-da52-4f85-ae2c-00ac6be68d7f" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f1f38b-c885-4970-9137-e973fcfc52c4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:59 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Deleted volume successfully. Sep 25 16:27:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7e5d8fad-cb8e-4100-a454-c8f074978a65 tempest-ProjectReaderTests-1798695758 None] Lock "cinder-84db10ae-987d-467b-a627-2dade69fb2ca-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:59 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f Sep 25 16:27:59 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Flow 'volume_create_manager' (48b56339-dd83-4801-b817-7a8801e14467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39a4428-5179-48fa-b12d-284d13b74875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39a4428-5179-48fa-b12d-284d13b74875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-757629046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3331ce5d-d485-496a-9924-e4d029eb9dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031ad947e06641c2bfa7070f78f4d9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:00Z,use_quota=True,user_id='e1abb67d63414b68835cfddf1a5500ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121ec96-8123-4ab5-bae3-b9eb86170593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121ec96-8123-4ab5-bae3-b9eb86170593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38c6360-9535-44ad-b29c-82998b0b3aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38c6360-9535-44ad-b29c-82998b0b3aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3331ce5d-d485-496a-9924-e4d029eb9dce', 'volume_name': 'volume-3331ce5d-d485-496a-9924-e4d029eb9dce', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1608e3-e81c-4896-a2e3-8308007c9ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1608e3-e81c-4896-a2e3-8308007c9ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd70e10-3934-4c76-a6ed-6d19073fb776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Volume 3331ce5d-d485-496a-9924-e4d029eb9dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3331ce5d-d485-496a-9924-e4d029eb9dce', 'volume_size': 1} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-757629046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3331ce5d-d485-496a-9924-e4d029eb9dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031ad947e06641c2bfa7070f78f4d9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:00Z,use_quota=True,user_id='e1abb67d63414b68835cfddf1a5500ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Creating volume 3331ce5d-d485-496a-9924-e4d029eb9dce {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:00 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:00 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f" returned: 0 in 0.445s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:00 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce 1073741824 Sep 25 16:28:00 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:00 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f Sep 25 16:28:00 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:00 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-4d4ef412-da52-4f85-ae2c-00ac6be68d7f" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Lock "cinder-quobyte-4d4ef412-da52-4f85-ae2c-00ac6be68d7f" released by "delete_volume" :: held 0.801s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Created reservations ['5b34eada-fd99-4d07-8844-de28bdc89f7e', 'a2eab4ca-897d-48c5-98fe-b66d0a59b2b7', '0f02b7e1-3d4a-45e1-88ef-950c3631b3c0', '50b66e54-4f74-4e98-8058-ff276422ef7a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:00 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:00 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:00 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce 1073741824" returned: 0 in 0.578s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-da938f33-f7b2-4b42-ac21-0a817921ed8c tempest-ProjectAdminTests-1930246413 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3252029418945, 'free_capacity_gb': 1775.3252029418945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87314) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 16:28:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:00 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce Sep 25 16:28:00 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:01 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.361s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Deleted volume successfully. Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-87cbd637-c4b6-4a42-9328-29317bb4ed3e tempest-CinderUnicodeTest-832196417 None] Lock "cinder-4d4ef412-da52-4f85-ae2c-00ac6be68d7f-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:01 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce" returned: 0 in 0.319s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd70e10-3934-4c76-a6ed-6d19073fb776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3331ce5d-d485-496a-9924-e4d029eb9dce', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e83ac8-6296-4364-a9ac-f46b05abde3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Volume volume-3331ce5d-d485-496a-9924-e4d029eb9dce (3331ce5d-d485-496a-9924-e4d029eb9dce): created successfully Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e83ac8-6296-4364-a9ac-f46b05abde3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Flow 'volume_create_manager' (48b56339-dd83-4801-b817-7a8801e14467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-06ee0727-db5f-408f-838b-c85088505eac tempest-ProjectReaderTests-1798695758 None] Created volume successfully. Sep 25 16:28:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Acquiring lock "cinder-3331ce5d-d485-496a-9924-e4d029eb9dce-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Lock "cinder-3331ce5d-d485-496a-9924-e4d029eb9dce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Acquiring lock "cinder-quobyte-3331ce5d-d485-496a-9924-e4d029eb9dce" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Lock "cinder-quobyte-3331ce5d-d485-496a-9924-e4d029eb9dce" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9869d3e-de76-4a69-8605-7793cfda2fd0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:02 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce Sep 25 16:28:02 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:02 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:02 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce Sep 25 16:28:02 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:03 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3331ce5d-d485-496a-9924-e4d029eb9dce" returned: 0 in 0.314s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Lock "cinder-quobyte-3331ce5d-d485-496a-9924-e4d029eb9dce" released by "delete_volume" :: held 0.771s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Created reservations ['8d7d5a34-1e2b-4cc9-8620-89248be68f1c', '7a457a37-78d0-4b61-9c02-81ad25c26b6f', 'b732d853-5da8-4356-9a51-a72f37a3da24', 'cca49cfd-a47e-41e5-9789-a9a1003025f4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:03 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:03 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:03 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.363s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Deleted volume successfully. Sep 25 16:28:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-007fc783-f88a-4b99-bb4b-4caa749c4ac7 tempest-ProjectReaderTests-1798695758 None] Lock "cinder-3331ce5d-d485-496a-9924-e4d029eb9dce-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (1178d822-d79a-49f1-9dac-696835687bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dbf755-09b7-402b-b757-58075f55654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dbf755-09b7-402b-b757-58075f55654b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049817452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:07Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fad801c-6d5d-410a-9944-5b530db150b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fad801c-6d5d-410a-9944-5b530db150b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92013b86-c9a4-4a5f-ac12-cbe455b85c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92013b86-c9a4-4a5f-ac12-cbe455b85c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e', 'volume_name': 'volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84f0379-3f69-4afc-94e3-c9cb0beaa3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84f0379-3f69-4afc-94e3-c9cb0beaa3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46dec2d-9e0c-4d56-b71b-0c5d07500abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Volume e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e', 'volume_size': 1} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049817452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:07Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Creating volume e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:07 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:07 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e 1073741824 Sep 25 16:28:07 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:07 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e 1073741824" returned: 0 in 0.666s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:07 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e Sep 25 16:28:07 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:08 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46dec2d-9e0c-4d56-b71b-0c5d07500abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5507bd38-2bf2-4f54-9f34-e7faf912abef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Volume volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e (e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e): created successfully Sep 25 16:28:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5507bd38-2bf2-4f54-9f34-e7faf912abef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (1178d822-d79a-49f1-9dac-696835687bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8e76e0e6-a69a-480a-98cb-ff80f3c30d37 tempest-ProjectReaderTests-510765395 None] Created volume successfully. Sep 25 16:28:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Creating offline snapshot 394e8e86-c984-422f-89d6-b9ae0b5c4e21 of volume e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c618d6c-09b2-4d10-968d-54eb62c51866]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:09 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e Sep 25 16:28:09 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:09 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" returned: 0 in 0.500s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:09 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 1G Sep 25 16:28:09 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:10 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 1G" returned: 0 in 0.538s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:10 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 Sep 25 16:28:10 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:10 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:10 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 is being set with open permissions: ugo+rw Sep 25 16:28:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:10 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 Sep 25 16:28:10 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:10 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21" returned: 0 in 0.259s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:11 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.info Sep 25 16:28:11 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:11 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.info" returned: 0 in 0.303s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:11 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.info is being set with open permissions: ugo+rw Sep 25 16:28:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:11 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.info Sep 25 16:28:11 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:11 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.info" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.385s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b8b675f9-d80f-43ac-b0da-1fb8bf1f8eb9 tempest-ProjectReaderTests-510765395 None] Create snapshot completed successfully Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (90749be2-795a-4918-ab2c-c3bf8cbd09ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ae3f55-7d8b-4f67-8e2c-3f554b6a561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ae3f55-7d8b-4f67-8e2c-3f554b6a561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47856381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917c82c4-5df5-46ff-8403-261852a5bbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:12Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac7a175-db96-44fc-8693-b4fdc008bd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac7a175-db96-44fc-8693-b4fdc008bd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15812b02-4f24-4ee2-8379-4a8713f3edea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15812b02-4f24-4ee2-8379-4a8713f3edea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917c82c4-5df5-46ff-8403-261852a5bbbc', 'volume_name': 'volume-917c82c4-5df5-46ff-8403-261852a5bbbc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfb8a3b-bc80-401b-b8e3-97c745a5d9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfb8a3b-bc80-401b-b8e3-97c745a5d9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00b654d-15aa-447c-94e3-d59f0fb45d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Volume 917c82c4-5df5-46ff-8403-261852a5bbbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917c82c4-5df5-46ff-8403-261852a5bbbc', 'volume_size': 1} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47856381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917c82c4-5df5-46ff-8403-261852a5bbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:12Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Creating volume 917c82c4-5df5-46ff-8403-261852a5bbbc {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:12 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:12 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc 1073741824 Sep 25 16:28:12 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-394e8e86-c984-422f-89d6-b9ae0b5c4e21-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-394e8e86-c984-422f-89d6-b9ae0b5c4e21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-394e8e86-c984-422f-89d6-b9ae0b5c4e21" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-394e8e86-c984-422f-89d6-b9ae0b5c4e21" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Deleting offline snapshot 394e8e86-c984-422f-89d6-b9ae0b5c4e21 of volume e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] snapshot_file for this snap is: volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ea42db-ef3d-49eb-a621-afbc39c3527e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:12 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc 1073741824" returned: 0 in 0.684s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:12 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 Sep 25 16:28:12 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:12 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc Sep 25 16:28:12 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:13 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21" returned: 0 in 0.407s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:13 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc" returned: 0 in 0.279s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00b654d-15aa-447c-94e3-d59f0fb45d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917c82c4-5df5-46ff-8403-261852a5bbbc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a190c11d-8ff5-4ca1-8673-37d929a1f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce33eeb-0567-4ed2-b048-b4f34a24708f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Volume volume-917c82c4-5df5-46ff-8403-261852a5bbbc (917c82c4-5df5-46ff-8403-261852a5bbbc): created successfully Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a190c11d-8ff5-4ca1-8673-37d929a1f227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (90749be2-795a-4918-ab2c-c3bf8cbd09ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e19ff82a-678a-4d9b-b4da-b58e5d67ce6d tempest-ProjectMemberTests-1163942405 None] Created volume successfully. Sep 25 16:28:13 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e Sep 25 16:28:13 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:13 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:13 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 Sep 25 16:28:13 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:13 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21" returned: 0 in 0.323s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:13 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21 Sep 25 16:28:13 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:14 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e.394e8e86-c984-422f-89d6-b9ae0b5c4e21" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-394e8e86-c984-422f-89d6-b9ae0b5c4e21" released by "_delete_snapshot" :: held 1.480s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" released by "delete_snapshot" :: held 1.506s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Created reservations ['8796b375-34f1-49b7-a3a9-132a4728a187', 'c2f4348e-b0c5-492f-bec1-be786300f1ba', '6aba7cf0-53d6-4d86-a187-db7d92ebab50', 'f39c54ca-3c2e-445a-8ba5-80b930775b6d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Delete snapshot completed successfully. Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-20d84958-8044-4e5d-b419-7c0291df44e6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-394e8e86-c984-422f-89d6-b9ae0b5c4e21-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Creating offline snapshot 0f0d6d42-254d-4c6b-beee-dc5032ae6016 of volume 917c82c4-5df5-46ff-8403-261852a5bbbc {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e831a2e-83b8-4292-ad6e-6147033ad801]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:14 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc Sep 25 16:28:14 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Lock "cinder-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:14 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc" returned: 0 in 0.404s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb37fc8f-d798-418b-8198-ba923e9d3ee0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:14 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 1G Sep 25 16:28:14 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:15 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e Sep 25 16:28:15 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:15 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:15 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e Sep 25 16:28:15 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:15 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 1G" returned: 0 in 0.424s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917c82c4-5df5-46ff-8403-261852a5bbbc -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:15 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917c82c4-5df5-46ff-8403-261852a5bbbc -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 Sep 25 16:28:15 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:15 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e" released by "delete_volume" :: held 0.731s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:15 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917c82c4-5df5-46ff-8403-261852a5bbbc -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:15 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 is being set with open permissions: ugo+rw Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:15 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 Sep 25 16:28:15 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Created reservations ['7b2cb645-24ec-457d-a015-86750a32b035', '3ddfb4e4-f8ed-4420-8b7c-4f4ab5235a34', 'e87079f7-e4ba-49b5-97f5-88263426c126', '0f8fb795-0a16-42f5-a013-103a491dfca9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:15 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:15 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:15 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:15 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.info Sep 25 16:28:15 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:16 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.304s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Deleted volume successfully. Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-202dc86f-8195-4e9f-86ac-939a4255f38d tempest-ProjectReaderTests-510765395 None] Lock "cinder-e1e91b3d-25c3-4870-a2c1-d1b75ed1d94e-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:16 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.info" returned: 0 in 0.270s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:16 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.info is being set with open permissions: ugo+rw Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:16 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.info Sep 25 16:28:16 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:16 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (7a5f17a5-de62-40bb-b5b7-5cc13eee35b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29ee41a-70f6-42b3-957a-649965c0ad10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.info" returned: 0 in 0.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29ee41a-70f6-42b3-957a-649965c0ad10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789461024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12801ae9-eca7-43f0-b377-c4ab780dd581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:16Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67174289-7cd0-473a-922d-a0204a5d671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67174289-7cd0-473a-922d-a0204a5d671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b2f477-10b7-4bde-b4cd-44b3a5cc9092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b2f477-10b7-4bde-b4cd-44b3a5cc9092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12801ae9-eca7-43f0-b377-c4ab780dd581', 'volume_name': 'volume-12801ae9-eca7-43f0-b377-c4ab780dd581', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f53476-c5ee-4df9-84ac-c6cd69c8f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f53476-c5ee-4df9-84ac-c6cd69c8f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c5b3c6-66d9-49a8-bad0-761da98a45e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Volume 12801ae9-eca7-43f0-b377-c4ab780dd581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12801ae9-eca7-43f0-b377-c4ab780dd581', 'volume_size': 1} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789461024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12801ae9-eca7-43f0-b377-c4ab780dd581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:16Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Creating volume 12801ae9-eca7-43f0-b377-c4ab780dd581 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:16 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:16 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 1073741824 Sep 25 16:28:16 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d9d73b42-c04e-434e-8cb5-48aa8dc9fd50 tempest-ProjectMemberTests-1163942405 None] Create snapshot completed successfully Sep 25 16:28:17 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 1073741824" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:17 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 Sep 25 16:28:17 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:17 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c5b3c6-66d9-49a8-bad0-761da98a45e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12801ae9-eca7-43f0-b377-c4ab780dd581', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40705283-9b30-4ce1-a882-b4a914e4171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:17 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Volume volume-12801ae9-eca7-43f0-b377-c4ab780dd581 (12801ae9-eca7-43f0-b377-c4ab780dd581): created successfully Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40705283-9b30-4ce1-a882-b4a914e4171f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (7a5f17a5-de62-40bb-b5b7-5cc13eee35b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a74313b3-d418-4666-880b-6beb6657b6bc tempest-ProjectReaderTests-510765395 None] Created volume successfully. Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-0f0d6d42-254d-4c6b-beee-dc5032ae6016-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-0f0d6d42-254d-4c6b-beee-dc5032ae6016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-917c82c4-5df5-46ff-8403-261852a5bbbc" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-917c82c4-5df5-46ff-8403-261852a5bbbc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-0f0d6d42-254d-4c6b-beee-dc5032ae6016" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0f0d6d42-254d-4c6b-beee-dc5032ae6016" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Deleting offline snapshot 0f0d6d42-254d-4c6b-beee-dc5032ae6016 of volume 917c82c4-5df5-46ff-8403-261852a5bbbc {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] snapshot_file for this snap is: volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[786f594c-84c6-4339-85cd-71ae74aace3e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Creating offline snapshot bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 of volume 12801ae9-eca7-43f0-b377-c4ab780dd581 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b88025-10d5-4bef-b355-b879c1eb0929]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:17 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 Sep 25 16:28:17 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:17 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 Sep 25 16:28:17 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:18 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016" returned: 0 in 0.417s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-917c82c4-5df5-46ff-8403-261852a5bbbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:18 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581" returned: 0 in 0.385s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe1e8c7-8c61-4014-88b7-bd0bf0e05130]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:18 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 1G Sep 25 16:28:18 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:18 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc Sep 25 16:28:18 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:18 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 1G" returned: 0 in 0.404s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12801ae9-eca7-43f0-b377-c4ab780dd581 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:18 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc" returned: 0 in 0.414s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:18 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12801ae9-eca7-43f0-b377-c4ab780dd581 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 Sep 25 16:28:18 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:18 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 Sep 25 16:28:18 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:18 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12801ae9-eca7-43f0-b377-c4ab780dd581 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6" returned: 0 in 0.312s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:18 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 is being set with open permissions: ugo+rw Sep 25 16:28:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:18 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 Sep 25 16:28:18 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:19 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:19 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016 Sep 25 16:28:19 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:19 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6" returned: 0 in 0.290s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:19 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.info Sep 25 16:28:19 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:19 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc.0f0d6d42-254d-4c6b-beee-dc5032ae6016" returned: 0 in 0.280s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0f0d6d42-254d-4c6b-beee-dc5032ae6016" released by "_delete_snapshot" :: held 1.641s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-917c82c4-5df5-46ff-8403-261852a5bbbc" released by "delete_snapshot" :: held 1.675s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Created reservations ['8f97c15f-b8f9-41e2-87b1-0f43fbf91706', '74b531fe-ae13-4cff-8cbc-5e97357a9308', '99460101-f83f-4a48-9d2b-fae3fe37d4df', '1fbc8ba1-cd63-4bba-9fcd-9c027444c66c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Delete snapshot completed successfully. Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ac67871-4a6d-487f-a95e-9d8381a80601 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-0f0d6d42-254d-4c6b-beee-dc5032ae6016-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:19 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.info" returned: 0 in 0.283s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:19 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.info is being set with open permissions: ugo+rw Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:19 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.info Sep 25 16:28:19 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:19 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.info" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-917c82c4-5df5-46ff-8403-261852a5bbbc-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-917c82c4-5df5-46ff-8403-261852a5bbbc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7f8569d4-d078-42d3-80ed-c0c268f05c3d tempest-ProjectReaderTests-510765395 None] Create snapshot completed successfully Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-917c82c4-5df5-46ff-8403-261852a5bbbc" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-917c82c4-5df5-46ff-8403-261852a5bbbc" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4eb9f2-7b16-4afa-9e8f-3f46cd913ee9]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:20 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc Sep 25 16:28:20 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:20 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:20 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc Sep 25 16:28:20 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:20 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-917c82c4-5df5-46ff-8403-261852a5bbbc" returned: 0 in 0.247s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-917c82c4-5df5-46ff-8403-261852a5bbbc" released by "delete_volume" :: held 0.681s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Created reservations ['90b9f804-7859-4b77-bea1-8fd051a250c2', '93bc27cd-4e17-4d54-b04e-547c5f564e49', '0bf14e67-a334-43c1-93a3-a3f6fca1e9be', '6b36aabe-4e7c-44f3-a7bd-c4ecbc857968'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:20 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:20 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Lock "cinder-bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-12801ae9-eca7-43f0-b377-c4ab780dd581" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-12801ae9-eca7-43f0-b377-c4ab780dd581" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Deleting offline snapshot bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 of volume 12801ae9-eca7-43f0-b377-c4ab780dd581 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:21 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] snapshot_file for this snap is: volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.333s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Deleted volume successfully. Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4cd59-0537-4cd3-a9ae-ed03afb2f47d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a08761-55ae-4040-9d89-ba0896d178ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-917c82c4-5df5-46ff-8403-261852a5bbbc-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:21 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 Sep 25 16:28:21 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:21 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6" returned: 0 in 0.406s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12801ae9-eca7-43f0-b377-c4ab780dd581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a79b4a-b393-437e-9580-5f2ab9ff7e55]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:21 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 Sep 25 16:28:21 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:21 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581" returned: 0 in 0.403s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:21 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 Sep 25 16:28:21 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:21 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (74b34ba7-1089-4b5d-a59a-a660e46cf26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6581c7-93c2-48d6-8e76-33ba3e2f96f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6581c7-93c2-48d6-8e76-33ba3e2f96f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502932707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:22Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feca5a38-91f4-4064-888d-f23cc8d5df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feca5a38-91f4-4064-888d-f23cc8d5df73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13f804c-1817-4a24-a382-3d56031a9134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13f804c-1817-4a24-a382-3d56031a9134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07', 'volume_name': 'volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c0c4ba-e44d-45bc-8d5f-eb7fd719726f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c0c4ba-e44d-45bc-8d5f-eb7fd719726f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebd583e-4a00-4b6a-bd5d-016239f15310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Volume 0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07', 'volume_size': 1} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502932707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:22Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Creating volume 0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:22 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:22 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 1073741824 Sep 25 16:28:22 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:22 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:22 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6 Sep 25 16:28:22 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:22 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 1073741824" returned: 0 in 0.478s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:22 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581.bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6" returned: 0 in 0.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6" released by "_delete_snapshot" :: held 1.622s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-12801ae9-eca7-43f0-b377-c4ab780dd581" released by "delete_snapshot" :: held 1.650s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:22 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 Sep 25 16:28:22 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Created reservations ['d15440fd-7855-478f-af42-ad2da0584ae0', '94f588e0-b984-410a-8449-ab89895c6b48', 'efc0f7a1-fc80-4263-852e-f85687828ff4', '97ab8ebc-a4bb-42cc-9cd1-fa58406a98ba'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Delete snapshot completed successfully. Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-60e08569-aa2b-4875-a03c-1ed54c9c145d tempest-ProjectReaderTests-510765395 None] Lock "cinder-bfcc6dd4-d2c7-4608-877b-d43c35dbe3b6-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:22 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" returned: 0 in 0.264s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebd583e-4a00-4b6a-bd5d-016239f15310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd42172-9984-4e6c-bcf7-44efb44cbc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Volume volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 (0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07): created successfully Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd42172-9984-4e6c-bcf7-44efb44cbc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (74b34ba7-1089-4b5d-a59a-a660e46cf26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-10fac145-9967-4159-9d01-41181540f4e5 tempest-ProjectMemberTests-1163942405 None] Created volume successfully. Sep 25 16:28:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-12801ae9-eca7-43f0-b377-c4ab780dd581-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Lock "cinder-12801ae9-eca7-43f0-b377-c4ab780dd581-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-12801ae9-eca7-43f0-b377-c4ab780dd581" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-12801ae9-eca7-43f0-b377-c4ab780dd581" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba5383d-1ec4-4adf-8f66-4233a58e9176]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:23 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 Sep 25 16:28:23 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:23 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:23 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581 Sep 25 16:28:23 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:23 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-12801ae9-eca7-43f0-b377-c4ab780dd581" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-12801ae9-eca7-43f0-b377-c4ab780dd581" released by "delete_volume" :: held 0.754s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Created reservations ['7fa56d78-1116-4ca5-acf0-4985bdffc4ca', 'b15f5a47-7ea3-4900-bfbd-96c6839ed585', 'e5e9ca00-0aa4-4c7a-be24-d6fbda2541aa', '9101f962-ecd7-4f23-b128-30c4218a297a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:24 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:24 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Creating offline snapshot 17642692-2287-4695-9b32-4c670ccd8937 of volume 0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[762988c1-ddaa-45f1-86e0-35b2244d8cff]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:24 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 Sep 25 16:28:24 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:24 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.295s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Deleted volume successfully. Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6156a31e-2f75-4cb0-a13e-46a2e62c38fc tempest-ProjectReaderTests-510765395 None] Lock "cinder-12801ae9-eca7-43f0-b377-c4ab780dd581-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:24 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" returned: 0 in 0.465s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:24 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 1G Sep 25 16:28:24 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (de791984-4dfa-43a0-bdb1-807aefb41bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f71704-cef6-43d8-8e72-3573e8852797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f71704-cef6-43d8-8e72-3573e8852797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903178184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae6ee03-acc2-4e10-b810-f781bf8217ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:25Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db79973-f777-4d80-a394-5cd4e3e1353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db79973-f777-4d80-a394-5cd4e3e1353e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f5b474-9c96-4a10-9cbd-f086926ae111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f5b474-9c96-4a10-9cbd-f086926ae111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae6ee03-acc2-4e10-b810-f781bf8217ba', 'volume_name': 'volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e150625c-d23f-423e-b5b5-1382a9df7099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e150625c-d23f-423e-b5b5-1382a9df7099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43da3c8c-ce2c-47cc-9993-61b83ceb32fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:24 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Volume 9ae6ee03-acc2-4e10-b810-f781bf8217ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba', 'volume_size': 1} Sep 25 16:28:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:25 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 1G" returned: 0 in 0.487s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:25 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 Sep 25 16:28:25 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:25 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937" returned: 0 in 0.304s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:25 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 is being set with open permissions: ugo+rw Sep 25 16:28:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:25 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 Sep 25 16:28:25 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:25 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:25 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.info Sep 25 16:28:25 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:26 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.info" returned: 0 in 0.283s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:26 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.info is being set with open permissions: ugo+rw Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:26 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.info Sep 25 16:28:26 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:26 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.info" returned: 0 in 0.273s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903178184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae6ee03-acc2-4e10-b810-f781bf8217ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:25Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Creating volume 9ae6ee03-acc2-4e10-b810-f781bf8217ba {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:26 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:26 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba 1073741824 Sep 25 16:28:26 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b4dbc1b2-e648-408b-bffe-941279bec3d3 tempest-ProjectMemberTests-1163942405 None] Create snapshot completed successfully Sep 25 16:28:26 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba 1073741824" returned: 0 in 0.482s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:27 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba Sep 25 16:28:27 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:27 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba" returned: 0 in 0.264s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43da3c8c-ce2c-47cc-9993-61b83ceb32fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2069a6-d76f-44f6-9478-f5fffc3a211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Volume volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba (9ae6ee03-acc2-4e10-b810-f781bf8217ba): created successfully Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2069a6-d76f-44f6-9478-f5fffc3a211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (de791984-4dfa-43a0-bdb1-807aefb41bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-77fdb551-ee76-4f93-867b-1bce8cca60e6 tempest-ProjectReaderTests-510765395 None] Created volume successfully. Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-17642692-2287-4695-9b32-4c670ccd8937-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Lock "cinder-17642692-2287-4695-9b32-4c670ccd8937-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-17642692-2287-4695-9b32-4c670ccd8937" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-17642692-2287-4695-9b32-4c670ccd8937" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Deleting offline snapshot 17642692-2287-4695-9b32-4c670ccd8937 of volume 0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] snapshot_file for this snap is: volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2816f302-498e-4404-b51a-137bda37a51c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:27 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 Sep 25 16:28:27 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:27 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937" returned: 0 in 0.380s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[280fb538-8e0d-4849-b180-713bbbe9823b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 Sep 25 16:28:28 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Creating offline snapshot 4c65bdb3-79ae-419f-9af0-fc6c26345fb1 of volume 9ae6ee03-acc2-4e10-b810-f781bf8217ba {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3be315-bfaf-4127-b79e-591d2327668a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" returned: 0 in 0.436s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 Sep 25 16:28:28 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba Sep 25 16:28:28 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937 Sep 25 16:28:28 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 1G Sep 25 16:28:28 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07.17642692-2287-4695-9b32-4c670ccd8937" returned: 0 in 0.273s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-17642692-2287-4695-9b32-4c670ccd8937" released by "_delete_snapshot" :: held 1.573s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" released by "delete_snapshot" :: held 1.601s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Created reservations ['d7b8788a-0acc-491e-b2bd-837fddd19397', '5ea88f89-8dd4-4e7c-b58b-b2a53530f1c4', '2eac17e6-e7bf-45bf-9f31-a6ce213deb48', '7938374e-50ba-473f-ba7a-167a1b14da54'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Delete snapshot completed successfully. Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58616b1c-97ad-4df7-bdbb-ba82342b92ed tempest-ProjectMemberTests-1163942405 None] Lock "cinder-17642692-2287-4695-9b32-4c670ccd8937-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:29 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 1G" returned: 0 in 0.525s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:29 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 Sep 25 16:28:29 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:29 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1" returned: 0 in 0.325s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 is being set with open permissions: ugo+rw Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:29 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 Sep 25 16:28:29 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4409519e-cfcc-490e-acb4-9015f2284f5d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:29 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 Sep 25 16:28:29 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:29 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:30 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.info Sep 25 16:28:30 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:30 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:30 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07 Sep 25 16:28:30 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:30 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.info" returned: 0 in 0.329s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:30 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.info is being set with open permissions: ugo+rw Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:30 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.info Sep 25 16:28:30 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:30 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07" released by "delete_volume" :: held 0.781s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Created reservations ['fc5fb6e7-5b0f-4fcf-89bc-f1d71551975f', 'fdf4208d-4992-4151-bb05-1e1f48472184', '7bc5c79f-79f2-4f81-a8ac-7af9d00019f0', '122a9712-7e8c-474f-ab64-589a7f2dc5f7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:30 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.info" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f175e1d4-a3e1-4a14-aa0b-0d9186a2fce3 tempest-ProjectReaderTests-510765395 None] Create snapshot completed successfully Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:30 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:30 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:30 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Deleted volume successfully. Sep 25 16:28:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7329f7db-ef14-4fb0-9a5e-d07f49c84935 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-0d3b4d0b-bf3c-41cd-83dc-a121b5cf9f07-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (0e9c2961-e97d-4d45-8d73-4a9b6c909aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439a73ff-c23e-4fe2-82b3-92a4749448af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439a73ff-c23e-4fe2-82b3-92a4749448af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816269132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73ad75c-4674-451b-b4be-c3e45054a264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:31Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bf137b-cd1f-42e1-9684-9f8e85f9ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bf137b-cd1f-42e1-9684-9f8e85f9ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd65d9d-09c8-47a8-a3cd-b9e5cffe7969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd65d9d-09c8-47a8-a3cd-b9e5cffe7969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73ad75c-4674-451b-b4be-c3e45054a264', 'volume_name': 'volume-b73ad75c-4674-451b-b4be-c3e45054a264', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb32b001-7069-45eb-afff-7c245eec1d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb32b001-7069-45eb-afff-7c245eec1d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba4f6f2-4aa3-467f-8746-b7f888f332a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Volume b73ad75c-4674-451b-b4be-c3e45054a264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73ad75c-4674-451b-b4be-c3e45054a264', 'volume_size': 1} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816269132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73ad75c-4674-451b-b4be-c3e45054a264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:31Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Creating volume b73ad75c-4674-451b-b4be-c3e45054a264 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:31 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-4c65bdb3-79ae-419f-9af0-fc6c26345fb1-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:31 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 1073741824 Sep 25 16:28:31 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Lock "cinder-4c65bdb3-79ae-419f-9af0-fc6c26345fb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-9ae6ee03-acc2-4e10-b810-f781bf8217ba" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-9ae6ee03-acc2-4e10-b810-f781bf8217ba" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-4c65bdb3-79ae-419f-9af0-fc6c26345fb1" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-4c65bdb3-79ae-419f-9af0-fc6c26345fb1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Deleting offline snapshot 4c65bdb3-79ae-419f-9af0-fc6c26345fb1 of volume 9ae6ee03-acc2-4e10-b810-f781bf8217ba {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] snapshot_file for this snap is: volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7958cb29-2da3-4a85-8231-88e5f85725dd]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:31 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 Sep 25 16:28:31 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:31 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 1073741824" returned: 0 in 0.462s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:31 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 Sep 25 16:28:31 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:32 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1" returned: 0 in 0.455s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36be179-8537-4e4d-b764-585da665260b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:32 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba Sep 25 16:28:32 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:32 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba4f6f2-4aa3-467f-8746-b7f888f332a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73ad75c-4674-451b-b4be-c3e45054a264', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636debcf-0115-4ad3-a749-069d89f7ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Volume volume-b73ad75c-4674-451b-b4be-c3e45054a264 (b73ad75c-4674-451b-b4be-c3e45054a264): created successfully Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636debcf-0115-4ad3-a749-069d89f7ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (0e9c2961-e97d-4d45-8d73-4a9b6c909aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4c33e3e5-0527-45a8-811e-f3b235aa35a8 tempest-ProjectMemberTests-1163942405 None] Created volume successfully. Sep 25 16:28:32 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba" returned: 0 in 0.419s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:32 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 Sep 25 16:28:32 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:32 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:32 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1 Sep 25 16:28:32 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:33 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba.4c65bdb3-79ae-419f-9af0-fc6c26345fb1" returned: 0 in 0.290s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-4c65bdb3-79ae-419f-9af0-fc6c26345fb1" released by "_delete_snapshot" :: held 1.660s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-9ae6ee03-acc2-4e10-b810-f781bf8217ba" released by "delete_snapshot" :: held 1.689s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Created reservations ['71c4f1da-a815-4b25-8f2b-bc04bace6b4c', '3d0237af-800f-429c-83a5-3304819622ea', '870e21b0-9a59-4ffc-bc8f-8c71ba10593b', '70b63e5f-af9b-4799-9bf7-725497ec245c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Delete snapshot completed successfully. Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d558873b-3b35-43dc-bb05-d56e9ab03dec tempest-ProjectReaderTests-510765395 None] Lock "cinder-4c65bdb3-79ae-419f-9af0-fc6c26345fb1-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Creating offline snapshot 0cca5b62-de50-4bf0-adf3-c88721a8ba3e of volume b73ad75c-4674-451b-b4be-c3e45054a264 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-9ae6ee03-acc2-4e10-b810-f781bf8217ba-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b9603b-0e6d-48a3-ae0c-c004d13950cd]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Lock "cinder-9ae6ee03-acc2-4e10-b810-f781bf8217ba-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-9ae6ee03-acc2-4e10-b810-f781bf8217ba" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-9ae6ee03-acc2-4e10-b810-f781bf8217ba" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b882ea7-79ee-4768-8bb6-1deb73ed633c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:33 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 Sep 25 16:28:33 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:33 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba Sep 25 16:28:33 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:34 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264" returned: 0 in 0.444s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:34 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e 1G Sep 25 16:28:34 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:34 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba" returned: 0 in 0.435s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:34 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba Sep 25 16:28:34 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:34 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-9ae6ee03-acc2-4e10-b810-f781bf8217ba" returned: 0 in 0.306s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:34 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e 1G" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73ad75c-4674-451b-b4be-c3e45054a264 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-9ae6ee03-acc2-4e10-b810-f781bf8217ba" released by "delete_volume" :: held 0.824s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:34 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73ad75c-4674-451b-b4be-c3e45054a264 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e Sep 25 16:28:34 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Created reservations ['fed23270-1bcf-4aae-a473-bee73ab2feca', '563486c0-c42b-4cb1-8a99-192ae3144d18', 'fed7236b-5a5a-41f3-8858-7c9f5550564f', '4405e255-6638-4160-bbf2-3d4389c8fd36'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:34 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:34 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:34 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73ad75c-4674-451b-b4be-c3e45054a264 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e" returned: 0 in 0.314s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:34 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e is being set with open permissions: ugo+rw Sep 25 16:28:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:34 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e Sep 25 16:28:34 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:35 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.290s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Deleted volume successfully. Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94d3eae0-ec14-4166-9928-412650b8fced tempest-ProjectReaderTests-510765395 None] Lock "cinder-9ae6ee03-acc2-4e10-b810-f781bf8217ba-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:35 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:35 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.info Sep 25 16:28:35 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (cbb49c80-0fcb-469c-87a2-747d3c4d5da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f54e40-cd78-4503-9960-78c24669e654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f54e40-cd78-4503-9960-78c24669e654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200152570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8342f882-b889-47b9-9af2-a3fdbd78da84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:35Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973d8564-5725-4f9b-95c3-bc55b15b6bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973d8564-5725-4f9b-95c3-bc55b15b6bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bd1f7a-af06-4ab4-a138-59dcdee9db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bd1f7a-af06-4ab4-a138-59dcdee9db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8342f882-b889-47b9-9af2-a3fdbd78da84', 'volume_name': 'volume-8342f882-b889-47b9-9af2-a3fdbd78da84', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ec6b0b-9c9a-422e-9857-dc0a95a892d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ec6b0b-9c9a-422e-9857-dc0a95a892d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ade046-4aac-4300-9819-37ccc9bb5dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Volume 8342f882-b889-47b9-9af2-a3fdbd78da84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8342f882-b889-47b9-9af2-a3fdbd78da84', 'volume_size': 1} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:35 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.info" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:35 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.info is being set with open permissions: ugo+rw Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:35 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.info Sep 25 16:28:35 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:35 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.info" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200152570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8342f882-b889-47b9-9af2-a3fdbd78da84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:35Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Creating volume 8342f882-b889-47b9-9af2-a3fdbd78da84 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:35 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:35 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 1073741824 Sep 25 16:28:35 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-384fdad4-4bca-42a5-969c-40903efc3366 tempest-ProjectMemberTests-1163942405 None] Create snapshot completed successfully Sep 25 16:28:36 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 1073741824" returned: 0 in 0.446s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:36 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 Sep 25 16:28:36 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:36 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84" returned: 0 in 0.263s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=145,cinder:UPDATE=186,cinder:INSERT=51,cinder:DELETE=14 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ade046-4aac-4300-9819-37ccc9bb5dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8342f882-b889-47b9-9af2-a3fdbd78da84', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b974ef-9e0e-451d-8ade-3252cc7427e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=201,cinder:SELECT=148,cinder:DELETE=18,cinder:INSERT=48 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:28:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Volume volume-8342f882-b889-47b9-9af2-a3fdbd78da84 (8342f882-b889-47b9-9af2-a3fdbd78da84): created successfully Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b974ef-9e0e-451d-8ade-3252cc7427e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (cbb49c80-0fcb-469c-87a2-747d3c4d5da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a5cbd750-eff9-40f4-b03a-a26d572d2d80 tempest-ProjectReaderTests-510765395 None] Created volume successfully. Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-0cca5b62-de50-4bf0-adf3-c88721a8ba3e-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-0cca5b62-de50-4bf0-adf3-c88721a8ba3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-b73ad75c-4674-451b-b4be-c3e45054a264" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-b73ad75c-4674-451b-b4be-c3e45054a264" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-0cca5b62-de50-4bf0-adf3-c88721a8ba3e" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0cca5b62-de50-4bf0-adf3-c88721a8ba3e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Deleting offline snapshot 0cca5b62-de50-4bf0-adf3-c88721a8ba3e of volume b73ad75c-4674-451b-b4be-c3e45054a264 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] snapshot_file for this snap is: volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[825feeb1-c130-4f4a-aa06-b83699fa55f3]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:37 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e Sep 25 16:28:37 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:37 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73ad75c-4674-451b-b4be-c3e45054a264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67f404-a8fd-4dd3-8362-a9195c30e47d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:37 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 Sep 25 16:28:37 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Creating offline snapshot a6317f4c-de2f-4fe4-93ae-ef7bec382701 of volume 8342f882-b889-47b9-9af2-a3fdbd78da84 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad52f88-70d1-4c17-97f8-e50e2090e06d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:37 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264" returned: 0 in 0.437s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:37 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e Sep 25 16:28:37 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:37 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 Sep 25 16:28:37 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:38 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:38 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 1G Sep 25 16:28:38 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:38 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:38 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e Sep 25 16:28:38 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:38 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264.0cca5b62-de50-4bf0-adf3-c88721a8ba3e" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0cca5b62-de50-4bf0-adf3-c88721a8ba3e" released by "_delete_snapshot" :: held 1.617s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-b73ad75c-4674-451b-b4be-c3e45054a264" released by "delete_snapshot" :: held 1.642s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:38 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 1G" returned: 0 in 0.466s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8342f882-b889-47b9-9af2-a3fdbd78da84 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Created reservations ['d043c3f3-f716-4769-ac46-f66f4a2c99d1', '2ac405f5-b36b-4193-8292-7841a9ccf73f', '6134cfb7-fd2a-4b99-8cc6-5a94c032f763', '9daab4bc-0a9e-4572-9821-57681df8e8c8'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:38 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8342f882-b889-47b9-9af2-a3fdbd78da84 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 Sep 25 16:28:38 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Delete snapshot completed successfully. Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f39da107-5c42-4f72-b474-660719f0478a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-0cca5b62-de50-4bf0-adf3-c88721a8ba3e-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:38 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8342f882-b889-47b9-9af2-a3fdbd78da84 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701" returned: 0 in 0.307s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:38 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 is being set with open permissions: ugo+rw Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:38 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 Sep 25 16:28:38 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-b73ad75c-4674-451b-b4be-c3e45054a264-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Lock "cinder-b73ad75c-4674-451b-b4be-c3e45054a264-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-b73ad75c-4674-451b-b4be-c3e45054a264" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-b73ad75c-4674-451b-b4be-c3e45054a264" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8734c07-a7fc-46c0-a673-4b819f85dfe4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:39 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:39 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.info Sep 25 16:28:39 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:39 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 Sep 25 16:28:39 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:39 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.info" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:39 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.info is being set with open permissions: ugo+rw Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:39 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.info Sep 25 16:28:39 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:39 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264" returned: 0 in 0.404s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:39 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264 Sep 25 16:28:39 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:39 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.info" returned: 0 in 0.284s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:39 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b73ad75c-4674-451b-b4be-c3e45054a264" returned: 0 in 0.285s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8c9ac784-7e54-448c-95de-7d7938172da0 tempest-ProjectReaderTests-510765395 None] Create snapshot completed successfully Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-b73ad75c-4674-451b-b4be-c3e45054a264" released by "delete_volume" :: held 0.772s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Created reservations ['5bf72bfc-4ba7-4181-887b-397e0355e283', 'edcaa3a6-c7ec-4350-be1b-3e8658d8791f', '2d692f4c-66da-4534-bc5a-486015819937', 'a53e355c-1178-4242-a659-8d9bc03d6800'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:39 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:39 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:40 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.284s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Deleted volume successfully. Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d9631fd9-92a0-4cee-a81c-76e0c544fa2e tempest-ProjectMemberTests-1163942405 None] Lock "cinder-b73ad75c-4674-451b-b4be-c3e45054a264-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (fbd8c50f-feae-4665-8ea2-0f27bd41a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce247429-aabb-4b33-a68b-05635c43fdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce247429-aabb-4b33-a68b-05635c43fdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058381970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef06e1b-c7dd-4a2f-8a5b-df86874847ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:41Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be171401-82ed-49ef-8586-8185c68b54ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be171401-82ed-49ef-8586-8185c68b54ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6f63d0-631e-462f-9b70-3462bc2535ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6f63d0-631e-462f-9b70-3462bc2535ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef06e1b-c7dd-4a2f-8a5b-df86874847ed', 'volume_name': 'volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7508deb5-cad7-4090-8c8a-749f958ac093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7508deb5-cad7-4090-8c8a-749f958ac093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05335573-88bf-461b-80d4-d39e166a448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Volume eef06e1b-c7dd-4a2f-8a5b-df86874847ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed', 'volume_size': 1} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058381970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef06e1b-c7dd-4a2f-8a5b-df86874847ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:41Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Creating volume eef06e1b-c7dd-4a2f-8a5b-df86874847ed {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:40 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:40 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed 1073741824 Sep 25 16:28:40 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-a6317f4c-de2f-4fe4-93ae-ef7bec382701-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Lock "cinder-a6317f4c-de2f-4fe4-93ae-ef7bec382701-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-8342f882-b889-47b9-9af2-a3fdbd78da84" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-8342f882-b889-47b9-9af2-a3fdbd78da84" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-a6317f4c-de2f-4fe4-93ae-ef7bec382701" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-a6317f4c-de2f-4fe4-93ae-ef7bec382701" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Deleting offline snapshot a6317f4c-de2f-4fe4-93ae-ef7bec382701 of volume 8342f882-b889-47b9-9af2-a3fdbd78da84 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] snapshot_file for this snap is: volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b596ec-181d-4ac9-9ad4-d7645530bd68]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:41 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 Sep 25 16:28:41 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:41 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed 1073741824" returned: 0 in 0.507s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:41 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed Sep 25 16:28:41 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:41 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8342f882-b889-47b9-9af2-a3fdbd78da84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae02587c-204e-4199-8bc2-ccefe414f7a0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:41 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 Sep 25 16:28:41 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:41 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05335573-88bf-461b-80d4-d39e166a448a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1d477a-d6f4-4650-882e-8648da11d4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Volume volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed (eef06e1b-c7dd-4a2f-8a5b-df86874847ed): created successfully Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1d477a-d6f4-4650-882e-8648da11d4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (fbd8c50f-feae-4665-8ea2-0f27bd41a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-79da12f6-91df-4d74-a303-d730673bcae7 tempest-ProjectMemberTests-1163942405 None] Created volume successfully. Sep 25 16:28:41 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:41 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 Sep 25 16:28:41 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:42 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701" returned: 0 in 0.329s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:42 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701 Sep 25 16:28:42 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:42 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84.a6317f4c-de2f-4fe4-93ae-ef7bec382701" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-a6317f4c-de2f-4fe4-93ae-ef7bec382701" released by "_delete_snapshot" :: held 1.517s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-8342f882-b889-47b9-9af2-a3fdbd78da84" released by "delete_snapshot" :: held 1.545s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Created reservations ['b7d2d5df-5c73-4400-9d95-736487d78c49', '367e1a1a-b855-43a8-aff7-6f651f095559', '69d74bd3-f5b5-463d-b0e2-f0fd50f70a4e', '5ca36035-21e0-4009-aba9-704ec2225330'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Delete snapshot completed successfully. Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-84cb6469-9704-40be-a833-ef37dc0e682b tempest-ProjectReaderTests-510765395 None] Lock "cinder-a6317f4c-de2f-4fe4-93ae-ef7bec382701-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Creating offline snapshot 4313dab7-9397-4ad3-aa0e-57b4c882eadb of volume eef06e1b-c7dd-4a2f-8a5b-df86874847ed {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d17de61-44f9-46e6-96e3-d2f4779f3257]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:42 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed Sep 25 16:28:42 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-8342f882-b889-47b9-9af2-a3fdbd78da84-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-8342f882-b889-47b9-9af2-a3fdbd78da84-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-8342f882-b889-47b9-9af2-a3fdbd78da84" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-8342f882-b889-47b9-9af2-a3fdbd78da84" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b175e0f-d006-40e2-904f-2cc5330583e0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:43 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 Sep 25 16:28:43 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:43 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" returned: 0 in 0.406s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:43 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb 1G Sep 25 16:28:43 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:43 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84" returned: 0 in 0.413s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:43 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84 Sep 25 16:28:43 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:43 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb 1G" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:43 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb Sep 25 16:28:43 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:43 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8342f882-b889-47b9-9af2-a3fdbd78da84" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-8342f882-b889-47b9-9af2-a3fdbd78da84" released by "delete_volume" :: held 0.765s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Created reservations ['20f375e4-89ae-497d-86e2-df32f3babc8f', 'f17a24cf-4f6e-4c97-ae32-8b1c07176e33', '424c6198-69d6-4405-a054-31e5ac192968', 'c0e58522-ed20-4c0d-abbd-8be1a8d27e5d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:43 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb" returned: 0 in 0.324s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:43 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb is being set with open permissions: ugo+rw Sep 25 16:28:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:43 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:43 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:44 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb Sep 25 16:28:44 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:44 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Deleted volume successfully. Sep 25 16:28:44 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb" returned: 0 in 0.284s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ce31455f-085d-4c2d-b9ad-9c5f448883b6 tempest-ProjectReaderTests-510765395 None] Lock "cinder-8342f882-b889-47b9-9af2-a3fdbd78da84-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:44 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.info Sep 25 16:28:44 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:44 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.info" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:44 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.info is being set with open permissions: ugo+rw Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:44 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.info Sep 25 16:28:44 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (db4e96b0-c350-49ac-b131-8a0ee97de587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18e86c6-df09-46ab-b5f9-89090c6a1ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18e86c6-df09-46ab-b5f9-89090c6a1ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1050135978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3debc5a3-e978-431a-bf8d-b1bce4aed5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:45Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f029d6-706e-4dd5-8d80-1d3460b76ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f029d6-706e-4dd5-8d80-1d3460b76ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa5c4e4-3864-438c-8f9a-71ac4bf89e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa5c4e4-3864-438c-8f9a-71ac4bf89e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3debc5a3-e978-431a-bf8d-b1bce4aed5da', 'volume_name': 'volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c65a245-1d1b-4630-88b8-bcd971780531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c65a245-1d1b-4630-88b8-bcd971780531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3514f516-eaa2-4ef4-afdf-d325a70c3733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Volume 3debc5a3-e978-431a-bf8d-b1bce4aed5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da', 'volume_size': 1} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:44 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.info" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1050135978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3debc5a3-e978-431a-bf8d-b1bce4aed5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0bff66755184426b90ab2a6cb0481e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:45Z,use_quota=True,user_id='462d1b11b1d0485f921dc7c475edb667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Creating volume 3debc5a3-e978-431a-bf8d-b1bce4aed5da {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:44 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:44 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da 1073741824 Sep 25 16:28:44 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-323f8c8b-010a-49ac-973e-fde94c518f37 tempest-ProjectMemberTests-1163942405 None] Create snapshot completed successfully Sep 25 16:28:45 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da 1073741824" returned: 0 in 0.445s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:45 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da Sep 25 16:28:45 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:45 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3514f516-eaa2-4ef4-afdf-d325a70c3733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057898eb-bb3d-471b-be69-559cabe13fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Volume volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da (3debc5a3-e978-431a-bf8d-b1bce4aed5da): created successfully Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057898eb-bb3d-471b-be69-559cabe13fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Flow 'volume_create_manager' (db4e96b0-c350-49ac-b131-8a0ee97de587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b4e3095e-c664-4ba9-8e8b-cc00264bcb09 tempest-ProjectReaderTests-510765395 None] Created volume successfully. Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-4313dab7-9397-4ad3-aa0e-57b4c882eadb-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-4313dab7-9397-4ad3-aa0e-57b4c882eadb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-4313dab7-9397-4ad3-aa0e-57b4c882eadb" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-4313dab7-9397-4ad3-aa0e-57b4c882eadb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Deleting offline snapshot 4313dab7-9397-4ad3-aa0e-57b4c882eadb of volume eef06e1b-c7dd-4a2f-8a5b-df86874847ed {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] snapshot_file for this snap is: volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4f190e-1b8a-4261-adb3-c7e86a6b46e4]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:46 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb Sep 25 16:28:46 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:46 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb" returned: 0 in 0.374s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02d3cd-1808-4a48-8eb2-8de2203e3e28]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:46 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed Sep 25 16:28:46 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:46 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:46 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb Sep 25 16:28:46 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Creating offline snapshot 7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea of volume 3debc5a3-e978-431a-bf8d-b1bce4aed5da {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b138f9b-1882-4767-8332-5eb88950ba9a]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:47 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da Sep 25 16:28:47 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:47 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb" returned: 0 in 0.356s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:47 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb Sep 25 16:28:47 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:47 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:47 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea 1G Sep 25 16:28:47 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:47 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed.4313dab7-9397-4ad3-aa0e-57b4c882eadb" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-4313dab7-9397-4ad3-aa0e-57b4c882eadb" released by "_delete_snapshot" :: held 1.468s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" released by "delete_snapshot" :: held 1.492s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Created reservations ['76ac0ce4-e6be-4a69-a9ba-c45465894027', 'c27be648-2401-490b-823e-eca0b37a7e31', 'e0a2e5d5-a515-4c31-8bf7-b0fd6a9f9a04', '36ede829-3abe-4f85-8f00-63cc0b04c74a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Delete snapshot completed successfully. Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-39f9fdf4-ad8e-4933-a2bf-90485469e91a tempest-ProjectMemberTests-1163942405 None] Lock "cinder-4313dab7-9397-4ad3-aa0e-57b4c882eadb-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:47 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea 1G" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:47 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea Sep 25 16:28:47 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:48 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea is being set with open permissions: ugo+rw Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:48 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea Sep 25 16:28:48 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-eef06e1b-c7dd-4a2f-8a5b-df86874847ed-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-eef06e1b-c7dd-4a2f-8a5b-df86874847ed-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dac259-1c57-4305-8314-d457a863401f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:48 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:48 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.info Sep 25 16:28:48 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed Sep 25 16:28:48 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.info" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:48 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.info is being set with open permissions: ugo+rw Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:48 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.info Sep 25 16:28:48 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" returned: 0 in 0.377s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:48 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed Sep 25 16:28:48 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.info" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c1648acb-a1dc-4ea5-9d3d-a28a4967b450 tempest-ProjectReaderTests-510765395 None] Create snapshot completed successfully Sep 25 16:28:48 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-eef06e1b-c7dd-4a2f-8a5b-df86874847ed" released by "delete_volume" :: held 0.701s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:48 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Created reservations ['311188bf-cddd-468e-998f-53cf8d729ceb', '42098d9a-dc60-4107-8fa4-a4866500b125', '2f56fc4b-0cf1-4592-93e8-e5a6a1fbb509', 'd887aa52-9737-443b-875c-d4970f3453b8'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:49 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:49 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Lock "cinder-7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-3debc5a3-e978-431a-bf8d-b1bce4aed5da" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-3debc5a3-e978-431a-bf8d-b1bce4aed5da" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Deleting offline snapshot 7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea of volume 3debc5a3-e978-431a-bf8d-b1bce4aed5da {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] snapshot_file for this snap is: volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a978ff09-19f0-4a5a-ac29-6f70dd9b0e91]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:49 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea Sep 25 16:28:49 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:49 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Deleted volume successfully. Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ab07f456-09d7-4316-aebf-418d7422f297 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-eef06e1b-c7dd-4a2f-8a5b-df86874847ed-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:49 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea" returned: 0 in 0.445s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[23528f7b-6b6f-49e0-a0ec-761702f1eddd]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:49 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da Sep 25 16:28:49 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (7bb05283-0176-4bb8-8358-89d10221fe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e79bab-505c-4201-95a3-23413340058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e79bab-505c-4201-95a3-23413340058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-67183579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72eede26-000b-497b-b9e4-5f94c08e0b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:50Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a765ac-cd2e-41df-8461-048507220ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a765ac-cd2e-41df-8461-048507220ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020f3829-b7c2-4678-983e-2fcda8f4a7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020f3829-b7c2-4678-983e-2fcda8f4a7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72eede26-000b-497b-b9e4-5f94c08e0b4c', 'volume_name': 'volume-72eede26-000b-497b-b9e4-5f94c08e0b4c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155bc085-0b84-4e6b-a9d3-6c0c40d46f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155bc085-0b84-4e6b-a9d3-6c0c40d46f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5ddae7-3f58-4c9a-85e4-79b44416a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:49 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Volume 72eede26-000b-497b-b9e4-5f94c08e0b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72eede26-000b-497b-b9e4-5f94c08e0b4c', 'volume_size': 1} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-67183579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72eede26-000b-497b-b9e4-5f94c08e0b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:50Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Creating volume 72eede26-000b-497b-b9e4-5f94c08e0b4c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:49 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:49 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c 1073741824 Sep 25 16:28:49 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:50 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:50 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea Sep 25 16:28:50 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:50 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c 1073741824" returned: 0 in 0.446s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:50 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c Sep 25 16:28:50 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:50 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:50 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea Sep 25 16:28:50 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:50 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c" returned: 0 in 0.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5ddae7-3f58-4c9a-85e4-79b44416a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72eede26-000b-497b-b9e4-5f94c08e0b4c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405fc37f-f8ad-43e7-9e70-25331420d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:50 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Volume volume-72eede26-000b-497b-b9e4-5f94c08e0b4c (72eede26-000b-497b-b9e4-5f94c08e0b4c): created successfully Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405fc37f-f8ad-43e7-9e70-25331420d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (7bb05283-0176-4bb8-8358-89d10221fe6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da.7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea" released by "_delete_snapshot" :: held 1.600s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0aafbb0f-2eb4-4058-9af3-abf4fe480afd tempest-ProjectMemberTests-1163942405 None] Created volume successfully. Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-3debc5a3-e978-431a-bf8d-b1bce4aed5da" released by "delete_snapshot" :: held 1.624s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Created reservations ['dab5aab8-7a16-470d-9b71-9085e2e029b1', '717ab582-173f-42ba-8594-7f602cceabd3', 'a4832b10-ac10-4007-b806-8812c4eb5431', '4f09f87e-5696-4f3c-a298-a63c7cb5a98e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Delete snapshot completed successfully. Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9ad1d038-5dfc-4c49-bd5a-112717316d42 tempest-ProjectReaderTests-510765395 None] Lock "cinder-7e46fdb7-c8d1-4ed0-bceb-b80cb5c674ea-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Creating offline snapshot fdc57c25-3623-4c10-973b-4c6b457fa1a8 of volume 72eede26-000b-497b-b9e4-5f94c08e0b4c {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9460ee4-4777-4ddb-80ca-f343a82e07e3]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:51 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c Sep 25 16:28:51 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-3debc5a3-e978-431a-bf8d-b1bce4aed5da-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Lock "cinder-3debc5a3-e978-431a-bf8d-b1bce4aed5da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Acquiring lock "cinder-quobyte-3debc5a3-e978-431a-bf8d-b1bce4aed5da" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-3debc5a3-e978-431a-bf8d-b1bce4aed5da" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[db758966-f09c-470d-8641-dfba7e94527d]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:51 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:51 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 1G Sep 25 16:28:51 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:51 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da Sep 25 16:28:51 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:51 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da" returned: 0 in 0.385s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:51 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da Sep 25 16:28:51 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:51 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 1G" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72eede26-000b-497b-b9e4-5f94c08e0b4c -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:51 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72eede26-000b-497b-b9e4-5f94c08e0b4c -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 Sep 25 16:28:51 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:52 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-3debc5a3-e978-431a-bf8d-b1bce4aed5da" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Lock "cinder-quobyte-3debc5a3-e978-431a-bf8d-b1bce4aed5da" released by "delete_volume" :: held 0.721s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Created reservations ['83d42a39-2c7f-4b83-b810-fe97d4070624', '6d737f5e-ad7a-4272-adee-3f5f6a467049', '77cef116-7112-4196-b8d2-c1ffc2f0f03b', 'd494e1eb-9def-43db-a0ee-a845c3b3b58d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:52 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72eede26-000b-497b-b9e4-5f94c08e0b4c -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8" returned: 0 in 0.357s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:52 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 is being set with open permissions: ugo+rw Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:52 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:52 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:52 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 Sep 25 16:28:52 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:52 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.300s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Deleted volume successfully. Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-baf843f9-b6b8-44f7-ab7c-25e565a8a611 tempest-ProjectReaderTests-510765395 None] Lock "cinder-3debc5a3-e978-431a-bf8d-b1bce4aed5da-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:52 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:52 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.info Sep 25 16:28:52 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:52 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.info" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:52 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.info is being set with open permissions: ugo+rw Sep 25 16:28:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:52 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.info Sep 25 16:28:52 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:53 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.info" returned: 0 in 0.322s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e5e53496-38be-4f8e-8f28-6e4c17f18624 tempest-ProjectMemberTests-1163942405 None] Create snapshot completed successfully Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-fdc57c25-3623-4c10-973b-4c6b457fa1a8-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-fdc57c25-3623-4c10-973b-4c6b457fa1a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-72eede26-000b-497b-b9e4-5f94c08e0b4c" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-72eede26-000b-497b-b9e4-5f94c08e0b4c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-fdc57c25-3623-4c10-973b-4c6b457fa1a8" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-fdc57c25-3623-4c10-973b-4c6b457fa1a8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Deleting offline snapshot fdc57c25-3623-4c10-973b-4c6b457fa1a8 of volume 72eede26-000b-497b-b9e4-5f94c08e0b4c {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] snapshot_file for this snap is: volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbb0542-80f0-42a7-a3dd-c2881af2ed21]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:54 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 Sep 25 16:28:54 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:54 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8" returned: 0 in 0.393s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72eede26-000b-497b-b9e4-5f94c08e0b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ea707-64a1-4bf7-ad30-292d569a8521]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:54 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c Sep 25 16:28:54 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:55 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c" returned: 0 in 0.376s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:55 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 Sep 25 16:28:55 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:55 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:55 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8 Sep 25 16:28:55 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:55 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c.fdc57c25-3623-4c10-973b-4c6b457fa1a8" returned: 0 in 0.275s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-fdc57c25-3623-4c10-973b-4c6b457fa1a8" released by "_delete_snapshot" :: held 1.520s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-72eede26-000b-497b-b9e4-5f94c08e0b4c" released by "delete_snapshot" :: held 1.543s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Created reservations ['d0306b14-ab43-4b83-a1cc-961f5db663e4', 'cb48cb6d-5407-4e38-aa18-260b0f14c805', 'abe8651a-7d1a-4fee-be66-5a2c2b25b0eb', '0242b165-209b-4055-866d-031f065e418d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Delete snapshot completed successfully. Sep 25 16:28:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b17e0073-00eb-43e6-b96b-26dc763557c7 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-fdc57c25-3623-4c10-973b-4c6b457fa1a8-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-72eede26-000b-497b-b9e4-5f94c08e0b4c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-72eede26-000b-497b-b9e4-5f94c08e0b4c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-72eede26-000b-497b-b9e4-5f94c08e0b4c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-72eede26-000b-497b-b9e4-5f94c08e0b4c" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aed004-142c-4a1c-9f4c-9bbdb71b406b]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:56 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c Sep 25 16:28:56 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:56 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:56 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c Sep 25 16:28:56 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:57 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-72eede26-000b-497b-b9e4-5f94c08e0b4c" returned: 0 in 0.274s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-72eede26-000b-497b-b9e4-5f94c08e0b4c" released by "delete_volume" :: held 0.706s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Created reservations ['e45c70b0-a9c6-4626-b816-68ed8dcbb12c', '0b1313d5-45b1-4205-8012-8e1b3359b060', '37dda389-fa3e-47c1-924d-a566a76acde6', '5e664b8f-a74c-4324-a9a7-1e025f399f4e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:57 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:57 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:57 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.273s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Deleted volume successfully. Sep 25 16:28:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0752ac17-c2cd-48ed-95c6-e98084e052d6 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-72eede26-000b-497b-b9e4-5f94c08e0b4c-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (dbe43ccc-23a4-4e51-8566-91e95457932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf8c98d-6b6d-4beb-b6ba-55292394f42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf8c98d-6b6d-4beb-b6ba-55292394f42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005841377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:58Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca232c0d-d950-4fd9-93c8-c33f2da59b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca232c0d-d950-4fd9-93c8-c33f2da59b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca44920-a4f4-46be-bbd1-72273d24edee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca44920-a4f4-46be-bbd1-72273d24edee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97', 'volume_name': 'volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abebe1ed-a4cd-405c-a477-3eff3585d8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abebe1ed-a4cd-405c-a477-3eff3585d8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ded1c2f-db4b-4548-b2f5-c7ac793f3b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Volume 0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97', 'volume_size': 1} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005841377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:58Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Creating volume 0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:58 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:58 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 1073741824 Sep 25 16:28:58 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:58 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:28:58 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:58 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:28:58 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 1073741824" returned: 0 in 0.470s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:59 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 Sep 25 16:28:59 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:59 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" returned: 0 in 0.358s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ded1c2f-db4b-4548-b2f5-c7ac793f3b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468b9240-5915-4595-b398-7b7bf2aec953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Volume volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 (0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97): created successfully Sep 25 16:28:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468b9240-5915-4595-b398-7b7bf2aec953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (dbe43ccc-23a4-4e51-8566-91e95457932f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1bec9de5-217f-45f5-b8f6-b717a0f1f382 tempest-ProjectMemberTests-1163942405 None] Created volume successfully. Sep 25 16:29:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Creating offline snapshot d675478f-77c6-41c3-ac34-a4f3148ef2b1 of volume 0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:00 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b32d0d-42e6-4c5d-9a24-1a6d24cb65bb]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:00 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 Sep 25 16:29:00 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:00 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" returned: 0 in 0.375s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:00 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 1G Sep 25 16:29:00 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:01 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 1G" returned: 0 in 0.459s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:01 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 Sep 25 16:29:01 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:01 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:01 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 is being set with open permissions: ugo+rw Sep 25 16:29:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:01 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 Sep 25 16:29:01 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:01 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1" returned: 0 in 0.264s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:02 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.info Sep 25 16:29:02 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:02 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.info" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:02 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.info is being set with open permissions: ugo+rw Sep 25 16:29:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:02 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.info Sep 25 16:29:02 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:02 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.info" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2665eb32-22a7-4cd9-893f-11a329da3d0b tempest-ProjectMemberTests-1163942405 None] Create snapshot completed successfully Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-d675478f-77c6-41c3-ac34-a4f3148ef2b1-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-d675478f-77c6-41c3-ac34-a4f3148ef2b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-d675478f-77c6-41c3-ac34-a4f3148ef2b1" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-d675478f-77c6-41c3-ac34-a4f3148ef2b1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Deleting offline snapshot d675478f-77c6-41c3-ac34-a4f3148ef2b1 of volume 0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] snapshot_file for this snap is: volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[379a76c7-9ccd-4fc3-b395-6411489f2940]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:03 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 Sep 25 16:29:03 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:04 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1" returned: 0 in 0.419s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2247e89e-aedf-4b6a-b990-e4dbd63095f0]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:04 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 Sep 25 16:29:04 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:04 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" returned: 0 in 0.424s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:04 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 Sep 25 16:29:04 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:05 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:05 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1 Sep 25 16:29:05 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:05 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97.d675478f-77c6-41c3-ac34-a4f3148ef2b1" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-d675478f-77c6-41c3-ac34-a4f3148ef2b1" released by "_delete_snapshot" :: held 1.613s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" released by "delete_snapshot" :: held 1.642s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Created reservations ['e878d78b-8e8d-437c-bd7c-55001296f2b5', '84340fdf-b094-4c16-b9e6-2e04c3a519e5', 'a729f9f1-263b-40be-bc03-ca97d83ee390', '3d44f123-fe9c-4dbd-bb08-efccb81f16ec'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Delete snapshot completed successfully. Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05e1d5fd-48d4-4197-a5bf-234ca878f6a9 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-d675478f-77c6-41c3-ac34-a4f3148ef2b1-delete_snapshot" released by "delete_snapshot" :: held 1.821s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Lock "cinder-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7772a5a-8260-47dc-8265-f35bd6aa0310]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:06 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 Sep 25 16:29:06 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:06 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" returned: 0 in 0.451s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:06 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97 Sep 25 16:29:06 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:06 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" returned: 0 in 0.279s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97" released by "delete_volume" :: held 0.811s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Created reservations ['b1ea3386-3023-4712-9c3e-97f7c1bb78d2', '7b20da58-51c0-4f39-bc95-8fc051452b64', '88e1a699-105e-49e4-b7a9-984bfaac2f4a', '9ffed43d-0989-4684-be7b-108c76ca820d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:06 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:29:06 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:07 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Deleted volume successfully. Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cf1314be-bcaa-46c4-b598-c388452032bc tempest-ProjectMemberTests-1163942405 None] Lock "cinder-0dd68e54-5cf1-4eeb-99c1-4a11b06ffe97-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (5d1f9cea-415a-400e-839b-095aabdbd68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532910a1-b205-4357-b186-aaeb1cbb7496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532910a1-b205-4357-b186-aaeb1cbb7496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629828833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf13689a-bd43-43fc-8f16-bf66a4cbfece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:08Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b37935-0fbb-4ace-a975-cd94cda7c139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b37935-0fbb-4ace-a975-cd94cda7c139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb7262a-dc25-49d7-829c-2f99a41c1003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb7262a-dc25-49d7-829c-2f99a41c1003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf13689a-bd43-43fc-8f16-bf66a4cbfece', 'volume_name': 'volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea258b1-7fec-4c37-80e6-41ea63005f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea258b1-7fec-4c37-80e6-41ea63005f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ea666c-c417-42bf-8a78-e9bbb0ecc9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Volume bf13689a-bd43-43fc-8f16-bf66a4cbfece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece', 'volume_size': 1} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629828833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf13689a-bd43-43fc-8f16-bf66a4cbfece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:08Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Creating volume bf13689a-bd43-43fc-8f16-bf66a4cbfece {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:07 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:29:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:07 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece 1073741824 Sep 25 16:29:07 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:08 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece 1073741824" returned: 0 in 0.563s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:08 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece Sep 25 16:29:08 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:08 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece" returned: 0 in 0.346s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ea666c-c417-42bf-8a78-e9bbb0ecc9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4b6cd3-244d-4b5c-9ec5-a5652aaed834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Volume volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece (bf13689a-bd43-43fc-8f16-bf66a4cbfece): created successfully Sep 25 16:29:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4b6cd3-244d-4b5c-9ec5-a5652aaed834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (5d1f9cea-415a-400e-839b-095aabdbd68a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8dc79cb6-a73c-4c10-abe6-5f63538317a6 tempest-ProjectMemberTests-1163942405 None] Created volume successfully. Sep 25 16:29:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Creating offline snapshot 1430cc96-efe6-4320-b84d-902170714f32 of volume bf13689a-bd43-43fc-8f16-bf66a4cbfece {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3405efa-431d-4a62-980a-96272081c837]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:10 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece Sep 25 16:29:10 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:10 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece" returned: 0 in 0.485s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:10 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 1G Sep 25 16:29:10 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:11 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 1G" returned: 0 in 0.466s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:11 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 Sep 25 16:29:11 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:11 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32" returned: 0 in 0.375s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:11 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 is being set with open permissions: ugo+rw Sep 25 16:29:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:11 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 Sep 25 16:29:11 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:11 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32" returned: 0 in 0.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:11 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.info Sep 25 16:29:11 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:12 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.info" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:12 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.info is being set with open permissions: ugo+rw Sep 25 16:29:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:12 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.info Sep 25 16:29:12 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:12 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.info" returned: 0 in 0.284s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d279bae0-8004-4128-a275-8475b3ff96b1 tempest-ProjectMemberTests-1163942405 None] Create snapshot completed successfully Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-1430cc96-efe6-4320-b84d-902170714f32-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-1430cc96-efe6-4320-b84d-902170714f32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-bf13689a-bd43-43fc-8f16-bf66a4cbfece" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-bf13689a-bd43-43fc-8f16-bf66a4cbfece" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-1430cc96-efe6-4320-b84d-902170714f32" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-1430cc96-efe6-4320-b84d-902170714f32" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Deleting offline snapshot 1430cc96-efe6-4320-b84d-902170714f32 of volume bf13689a-bd43-43fc-8f16-bf66a4cbfece {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] snapshot_file for this snap is: volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee3b5fa-5a07-4c9f-89ec-768674d1de5e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:13 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 Sep 25 16:29:13 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:13 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d425d6-b10e-4292-9d1d-45697d34870f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:13 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece Sep 25 16:29:13 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:14 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece" returned: 0 in 0.367s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:14 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 Sep 25 16:29:14 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:14 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32" returned: 0 in 0.397s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:14 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32 Sep 25 16:29:14 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:14 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece.1430cc96-efe6-4320-b84d-902170714f32" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-1430cc96-efe6-4320-b84d-902170714f32" released by "_delete_snapshot" :: held 1.539s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-bf13689a-bd43-43fc-8f16-bf66a4cbfece" released by "delete_snapshot" :: held 1.565s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Created reservations ['eb2ff440-b6d7-4617-b736-8ee883102346', '7a95bd14-6365-4cf0-b1c3-fad53448ed2f', '565b2e93-a3fe-4ca9-9dc4-5eee2bdf3a5a', '734cb788-c716-4aa1-95aa-8232d8c7e951'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Delete snapshot completed successfully. Sep 25 16:29:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8637bc7-b420-4e40-9826-1925523dd6ac tempest-ProjectMemberTests-1163942405 None] Lock "cinder-1430cc96-efe6-4320-b84d-902170714f32-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-bf13689a-bd43-43fc-8f16-bf66a4cbfece-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Lock "cinder-bf13689a-bd43-43fc-8f16-bf66a4cbfece-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-bf13689a-bd43-43fc-8f16-bf66a4cbfece" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-bf13689a-bd43-43fc-8f16-bf66a4cbfece" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bf3e3e-b719-4c10-b3e2-5fc740535fa9]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:15 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece Sep 25 16:29:15 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:15 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:15 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece Sep 25 16:29:15 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:16 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-bf13689a-bd43-43fc-8f16-bf66a4cbfece" returned: 0 in 0.285s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-bf13689a-bd43-43fc-8f16-bf66a4cbfece" released by "delete_volume" :: held 0.751s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Created reservations ['f646cba3-3300-47e7-b4b5-20e92c705ce6', 'eefb62a5-112b-4e89-9d6f-fa63a0bec626', '3f5c8c69-b49e-4974-948b-73497a59772c', 'c030bb41-cc85-4f4b-b8fd-8a8bb7ba64de'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:16 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:29:16 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:16 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Deleted volume successfully. Sep 25 16:29:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4d2d7260-c694-4e7d-bc20-3ae198e116fc tempest-ProjectMemberTests-1163942405 None] Lock "cinder-bf13689a-bd43-43fc-8f16-bf66a4cbfece-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (74c7b547-c0b1-4df3-be5d-3a5745f910bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a8a523-e253-4170-a45f-8e84eaffdccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a8a523-e253-4170-a45f-8e84eaffdccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645036918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c38122-470a-45ee-8b1a-27781b7d4bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:17Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294fe398-f459-4bc2-8caa-b4264e9d9880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294fe398-f459-4bc2-8caa-b4264e9d9880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c205807a-db78-4d10-bdf8-155c374ae762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c205807a-db78-4d10-bdf8-155c374ae762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c38122-470a-45ee-8b1a-27781b7d4bdd', 'volume_name': 'volume-01c38122-470a-45ee-8b1a-27781b7d4bdd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e5da2f-8388-4823-b08d-0ea2b0ce07a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e5da2f-8388-4823-b08d-0ea2b0ce07a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd9d108-3f19-482f-8f27-f04feb8455b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:17 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Volume 01c38122-470a-45ee-8b1a-27781b7d4bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c38122-470a-45ee-8b1a-27781b7d4bdd', 'volume_size': 1} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645036918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c38122-470a-45ee-8b1a-27781b7d4bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:17Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Creating volume 01c38122-470a-45ee-8b1a-27781b7d4bdd {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:17 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:17 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd 1073741824 Sep 25 16:29:17 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:17 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd 1073741824" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:17 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd Sep 25 16:29:17 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:18 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd" returned: 0 in 0.300s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd9d108-3f19-482f-8f27-f04feb8455b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c38122-470a-45ee-8b1a-27781b7d4bdd', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282186fb-dd97-466c-bf92-07484a89def8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:18 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Volume volume-01c38122-470a-45ee-8b1a-27781b7d4bdd (01c38122-470a-45ee-8b1a-27781b7d4bdd): created successfully Sep 25 16:29:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282186fb-dd97-466c-bf92-07484a89def8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (74c7b547-c0b1-4df3-be5d-3a5745f910bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b8193062-8c9c-4c61-808d-8788c45598bd tempest-ProjectMemberTests-1163942405 None] Created volume successfully. Sep 25 16:29:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Creating offline snapshot 5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 of volume 01c38122-470a-45ee-8b1a-27781b7d4bdd {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d23d3c-325d-4ac0-af4c-ec439b5bc22c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:19 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd Sep 25 16:29:19 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:19 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:19 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 1G Sep 25 16:29:19 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:20 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 1G" returned: 0 in 0.409s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01c38122-470a-45ee-8b1a-27781b7d4bdd -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:20 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01c38122-470a-45ee-8b1a-27781b7d4bdd -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 Sep 25 16:29:20 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:20 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01c38122-470a-45ee-8b1a-27781b7d4bdd -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:20 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 is being set with open permissions: ugo+rw Sep 25 16:29:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:20 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 Sep 25 16:29:20 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:20 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34" returned: 0 in 0.240s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:20 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.info Sep 25 16:29:20 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:21 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.info" returned: 0 in 0.259s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:21 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.info is being set with open permissions: ugo+rw Sep 25 16:29:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:21 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.info Sep 25 16:29:21 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:21 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.info" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7a83b3e8-692d-4b2f-a9aa-f49e50b50971 tempest-ProjectMemberTests-1163942405 None] Create snapshot completed successfully Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-01c38122-470a-45ee-8b1a-27781b7d4bdd" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-01c38122-470a-45ee-8b1a-27781b7d4bdd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Deleting offline snapshot 5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 of volume 01c38122-470a-45ee-8b1a-27781b7d4bdd {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] snapshot_file for this snap is: volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4f4696-d2ae-4476-a777-2a7f84f0f785]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:22 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 Sep 25 16:29:22 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01c38122-470a-45ee-8b1a-27781b7d4bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[25175919-a627-4127-988e-2e2cd8994ef3]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:23 devstack sudo[109315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd Sep 25 16:29:23 devstack sudo[109315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack sudo[109315]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd" returned: 0 in 0.360s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:23 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 Sep 25 16:29:23 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34" returned: 0 in 0.360s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:23 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34 Sep 25 16:29:23 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:24 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd.5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34" released by "_delete_snapshot" :: held 1.451s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-01c38122-470a-45ee-8b1a-27781b7d4bdd" released by "delete_snapshot" :: held 1.476s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:24 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Created reservations ['d622d752-d960-4a8a-9809-82695fdb2194', 'dbac82a5-c8ee-420c-ae40-3e27a30fe904', '2a7520ab-a66f-44af-b65c-f141e25d251a', 'ccb04e08-d67a-4af1-bfd7-ce7f20d96097'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Delete snapshot completed successfully. Sep 25 16:29:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-59d9174a-2aaa-4dcb-80c8-2bca687fa7f8 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-5674e0d3-1b70-4b38-a29f-b1f5e3bc0c34-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-01c38122-470a-45ee-8b1a-27781b7d4bdd-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Lock "cinder-01c38122-470a-45ee-8b1a-27781b7d4bdd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-01c38122-470a-45ee-8b1a-27781b7d4bdd" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-01c38122-470a-45ee-8b1a-27781b7d4bdd" acquired by "delete_volume" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:25 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0478f658-355f-42a5-9206-41f75afb6cfa]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:25 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd Sep 25 16:29:25 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:25 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:25 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd Sep 25 16:29:25 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:25 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-01c38122-470a-45ee-8b1a-27781b7d4bdd" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-01c38122-470a-45ee-8b1a-27781b7d4bdd" released by "delete_volume" :: held 0.686s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Created reservations ['ff4331c8-3513-4c7f-9b22-72ed516e36b3', '54219820-067e-4f91-94ab-2395813b060e', '04d73432-b13c-423a-8e86-91bb5d377333', '7d5d2102-e0a1-4a37-bcf6-62925e22e02f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:26 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:29:26 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:26 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.247s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Deleted volume successfully. Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aad577f7-1920-478b-b98a-e32872ed86ba tempest-ProjectMemberTests-1163942405 None] Lock "cinder-01c38122-470a-45ee-8b1a-27781b7d4bdd-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (06bde6a7-3433-4e82-8a40-5f404d57dc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3954829-97c2-41b9-9c00-f35ed9c2abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3954829-97c2-41b9-9c00-f35ed9c2abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503096961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d59dca8-0126-4e3f-a145-705127ccfbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:27Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03948255-a21f-4b6c-87fa-cc70783624ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03948255-a21f-4b6c-87fa-cc70783624ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8393be-9042-465b-9d0a-eba24fe6084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8393be-9042-465b-9d0a-eba24fe6084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d59dca8-0126-4e3f-a145-705127ccfbd3', 'volume_name': 'volume-8d59dca8-0126-4e3f-a145-705127ccfbd3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cec058a-4d07-4812-97bc-d80db16f9ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cec058a-4d07-4812-97bc-d80db16f9ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4affee23-a71c-4c76-bc19-4ecc9899171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Volume 8d59dca8-0126-4e3f-a145-705127ccfbd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d59dca8-0126-4e3f-a145-705127ccfbd3', 'volume_size': 1} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503096961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d59dca8-0126-4e3f-a145-705127ccfbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ee2ac7bc74c938e3e6e2ff074ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:27Z,use_quota=True,user_id='9e29c5e8afd04ce98730f5ceae31700d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Creating volume 8d59dca8-0126-4e3f-a145-705127ccfbd3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:26 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:29:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:26 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 1073741824 Sep 25 16:29:26 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:27 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 1073741824" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:27 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 Sep 25 16:29:27 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:27 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3" returned: 0 in 0.258s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4affee23-a71c-4c76-bc19-4ecc9899171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d59dca8-0126-4e3f-a145-705127ccfbd3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71004922-2f45-4f92-a708-c64179975bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Volume volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 (8d59dca8-0126-4e3f-a145-705127ccfbd3): created successfully Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71004922-2f45-4f92-a708-c64179975bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Flow 'volume_create_manager' (06bde6a7-3433-4e82-8a40-5f404d57dc1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-26afc58c-251a-455f-a5f8-6628541d3c16 tempest-ProjectMemberTests-1163942405 None] Created volume successfully. Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Creating offline snapshot f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 of volume 8d59dca8-0126-4e3f-a145-705127ccfbd3 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf34e4e8-1be5-41c0-813e-63dd291f32cf]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:28 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 Sep 25 16:29:28 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:28 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:28 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 1G Sep 25 16:29:28 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:28 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 1G" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:28 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 Sep 25 16:29:28 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:29 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 -F qcow2 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 is being set with open permissions: ugo+rw Sep 25 16:29:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:29 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 Sep 25 16:29:29 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:29 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846" returned: 0 in 0.269s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:29 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.info Sep 25 16:29:29 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:29 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.info" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.info is being set with open permissions: ugo+rw Sep 25 16:29:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:29 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.info Sep 25 16:29:29 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:29 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.info" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-de0b2d04-8b55-4f60-9996-508f05da0305 tempest-ProjectMemberTests-1163942405 None] Create snapshot completed successfully Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-f296f0ca-04d3-4f5a-a5f2-3f384dd2a846-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Lock "cinder-f296f0ca-04d3-4f5a-a5f2-3f384dd2a846-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-8d59dca8-0126-4e3f-a145-705127ccfbd3" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-8d59dca8-0126-4e3f-a145-705127ccfbd3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-f296f0ca-04d3-4f5a-a5f2-3f384dd2a846" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-f296f0ca-04d3-4f5a-a5f2-3f384dd2a846" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Deleting offline snapshot f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 of volume 8d59dca8-0126-4e3f-a145-705127ccfbd3 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] snapshot_file for this snap is: volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c8de30-578e-4344-852d-03f735952620]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:30 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 Sep 25 16:29:30 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:30 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d59dca8-0126-4e3f-a145-705127ccfbd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4d9624-7ebb-467e-b4d2-2c48a60c91d7]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:30 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 Sep 25 16:29:30 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:31 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3" returned: 0 in 0.372s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:31 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 Sep 25 16:29:31 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:31 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846" returned: 0 in 0.329s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:31 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846 Sep 25 16:29:31 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:31 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3.f296f0ca-04d3-4f5a-a5f2-3f384dd2a846" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-f296f0ca-04d3-4f5a-a5f2-3f384dd2a846" released by "_delete_snapshot" :: held 1.428s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-8d59dca8-0126-4e3f-a145-705127ccfbd3" released by "delete_snapshot" :: held 1.449s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:31 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Created reservations ['72e8e54e-96c3-4be3-8e28-15e3a6b8b96a', '5a2a5247-120a-40f5-a058-70416da7f0bd', '631fb3a0-c52b-49e9-be42-462e7ac263a1', 'e64a4678-a134-4292-8dfb-88efedb64295'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Delete snapshot completed successfully. Sep 25 16:29:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-426f2566-cfe0-4e97-a97c-02133fd332cf tempest-ProjectMemberTests-1163942405 None] Lock "cinder-f296f0ca-04d3-4f5a-a5f2-3f384dd2a846-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-8d59dca8-0126-4e3f-a145-705127ccfbd3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-8d59dca8-0126-4e3f-a145-705127ccfbd3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "cinder-quobyte-8d59dca8-0126-4e3f-a145-705127ccfbd3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-8d59dca8-0126-4e3f-a145-705127ccfbd3" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e953d5-cef2-47c8-a741-18c71606048f]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:32 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 Sep 25 16:29:32 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:32 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3" returned: 0 in 0.352s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:32 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3 Sep 25 16:29:32 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:33 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-8d59dca8-0126-4e3f-a145-705127ccfbd3" returned: 0 in 0.237s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-quobyte-8d59dca8-0126-4e3f-a145-705127ccfbd3" released by "delete_volume" :: held 0.652s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Created reservations ['d97f3d33-5c10-4363-a971-1415c69acf73', 'eae4a5b7-4fb5-40e6-9c40-3997e8a4500a', '23b08b67-bf91-4dd8-8258-cb04d43bbc22', 'ed0ed388-c036-4272-87ca-6ec3baadca88'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:33 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:29:33 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:33 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Deleted volume successfully. Sep 25 16:29:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9af9f946-7836-4a40-b3e8-2f77eeb71046 tempest-ProjectMemberTests-1163942405 None] Lock "cinder-8d59dca8-0126-4e3f-a145-705127ccfbd3-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:43 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=157,cinder:DELETE=16,cinder:SELECT=118,cinder:INSERT=44 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:29:43 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=122,cinder:INSERT=43,cinder:UPDATE=154,cinder:DELETE=9 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Flow 'volume_create_manager' (2075da56-8649-46e3-a51f-556a455fffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8997b590-8c7b-49d9-96eb-740d1e6c1f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8997b590-8c7b-49d9-96eb-740d1e6c1f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547125782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2810673-e88e-4b27-a0c2-67966db09581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb022dc40584772b4685fc590f29ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:44Z,use_quota=True,user_id='21ed62d54db54fabae1451315353d91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0765edfd-fd16-4de0-8577-44dcd90d5ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0765edfd-fd16-4de0-8577-44dcd90d5ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54dbb408-1502-4e26-a995-7609e9946c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54dbb408-1502-4e26-a995-7609e9946c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2810673-e88e-4b27-a0c2-67966db09581', 'volume_name': 'volume-b2810673-e88e-4b27-a0c2-67966db09581', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e118f16-0404-4574-b845-d9e6bb476296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e118f16-0404-4574-b845-d9e6bb476296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba9af87-f1d0-4568-9bb8-e4ccc914e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Volume b2810673-e88e-4b27-a0c2-67966db09581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2810673-e88e-4b27-a0c2-67966db09581', 'volume_size': 1} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547125782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2810673-e88e-4b27-a0c2-67966db09581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb022dc40584772b4685fc590f29ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:44Z,use_quota=True,user_id='21ed62d54db54fabae1451315353d91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Creating volume b2810673-e88e-4b27-a0c2-67966db09581 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:44 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:44 devstack sudo[109407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581 1073741824 Sep 25 16:29:44 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:44 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581 1073741824" returned: 0 in 0.420s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581 Sep 25 16:29:45 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:45 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba9af87-f1d0-4568-9bb8-e4ccc914e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2810673-e88e-4b27-a0c2-67966db09581', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f976e683-a676-444e-9bd9-d9618d5a2d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Volume volume-b2810673-e88e-4b27-a0c2-67966db09581 (b2810673-e88e-4b27-a0c2-67966db09581): created successfully Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f976e683-a676-444e-9bd9-d9618d5a2d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Flow 'volume_create_manager' (2075da56-8649-46e3-a51f-556a455fffeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5c060e94-c8d1-496d-96a3-8ecc7a642ef3 tempest-ProjectReaderTests-346839777 None] Created volume successfully. Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Acquiring lock "cinder-b2810673-e88e-4b27-a0c2-67966db09581-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Lock "cinder-b2810673-e88e-4b27-a0c2-67966db09581-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Acquiring lock "cinder-quobyte-b2810673-e88e-4b27-a0c2-67966db09581" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Lock "cinder-quobyte-b2810673-e88e-4b27-a0c2-67966db09581" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[298aebb5-1820-4825-9471-36e12b5aa31c]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack sudo[109416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581 Sep 25 16:29:45 devstack sudo[109416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack sudo[109416]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581 Sep 25 16:29:46 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-b2810673-e88e-4b27-a0c2-67966db09581" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Lock "cinder-quobyte-b2810673-e88e-4b27-a0c2-67966db09581" released by "delete_volume" :: held 0.652s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Created reservations ['4cb11246-a26b-436f-a4eb-c106a9b3509a', '60fa3436-8deb-4b19-92e2-51ad76c9ef21', '3ca1d154-6e0f-4570-918c-f51a8581e9b5', 'a7cc2d33-9961-42d6-a643-6c76fb03a317'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:29:46 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Deleted volume successfully. Sep 25 16:29:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8947dc0d-88ad-4a63-a963-85f2941a0435 tempest-ProjectReaderTests-346839777 None] Lock "cinder-b2810673-e88e-4b27-a0c2-67966db09581-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Flow 'volume_create_manager' (7191e249-48c4-414f-a8c2-dd9d7f8c9900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2823b726-ff91-4655-883a-9ce11b7d8a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2823b726-ff91-4655-883a-9ce11b7d8a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183100191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60b202b-3a5a-4c53-ae3b-56f084c8afd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb022dc40584772b4685fc590f29ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:47Z,use_quota=True,user_id='21ed62d54db54fabae1451315353d91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87e838a-96aa-4cc1-be03-19975f2d28b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87e838a-96aa-4cc1-be03-19975f2d28b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ac802d-7eb0-4d87-a878-6eeaee36f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ac802d-7eb0-4d87-a878-6eeaee36f333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60b202b-3a5a-4c53-ae3b-56f084c8afd3', 'volume_name': 'volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75e8efd-6c20-4515-bde2-7ae5b04383b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75e8efd-6c20-4515-bde2-7ae5b04383b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6586cd0-3cc3-4f54-bb9c-67cb11a1422d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Volume c60b202b-3a5a-4c53-ae3b-56f084c8afd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3', 'volume_size': 1} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183100191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60b202b-3a5a-4c53-ae3b-56f084c8afd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb022dc40584772b4685fc590f29ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:47Z,use_quota=True,user_id='21ed62d54db54fabae1451315353d91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Creating volume c60b202b-3a5a-4c53-ae3b-56f084c8afd3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:47 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:47 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 1073741824 Sep 25 16:29:47 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:47 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 1073741824" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:47 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 Sep 25 16:29:47 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3" returned: 0 in 0.233s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6586cd0-3cc3-4f54-bb9c-67cb11a1422d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46db6cf2-64f6-407b-aad5-714e77c0767b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Volume volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 (c60b202b-3a5a-4c53-ae3b-56f084c8afd3): created successfully Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46db6cf2-64f6-407b-aad5-714e77c0767b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Flow 'volume_create_manager' (7191e249-48c4-414f-a8c2-dd9d7f8c9900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-40e7746a-a053-44f0-9f73-37ca2d658f44 tempest-ProjectReaderTests-346839777 None] Created volume successfully. Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Acquiring lock "cinder-c60b202b-3a5a-4c53-ae3b-56f084c8afd3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Lock "cinder-c60b202b-3a5a-4c53-ae3b-56f084c8afd3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Acquiring lock "cinder-quobyte-c60b202b-3a5a-4c53-ae3b-56f084c8afd3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Lock "cinder-quobyte-c60b202b-3a5a-4c53-ae3b-56f084c8afd3" acquired by "delete_volume" :: waited 0.012s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa74b41e-0dbd-47a7-bc82-4d56cf33a309]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 Sep 25 16:29:48 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3" returned: 0 in 0.341s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3 Sep 25 16:29:48 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-c60b202b-3a5a-4c53-ae3b-56f084c8afd3" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Lock "cinder-quobyte-c60b202b-3a5a-4c53-ae3b-56f084c8afd3" released by "delete_volume" :: held 0.634s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Created reservations ['2f9ba384-1539-4ecc-86b6-760103841b17', 'aff1ff2c-227f-4fe3-b91a-1fbce4e810d5', '476d61d7-52c4-47c5-ae75-c145fb9e6f28', '28abd509-3de8-437a-b45f-e4d680f05310'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:49 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:29:49 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:49 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.236s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Deleted volume successfully. Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b3069a0b-82be-411f-930c-d5287e5ef57b tempest-ProjectReaderTests-346839777 None] Lock "cinder-c60b202b-3a5a-4c53-ae3b-56f084c8afd3-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Flow 'volume_create_manager' (cc105da3-51f1-4a53-8007-3c777698bb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195d586c-7a5b-4d17-8b23-97382992d552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195d586c-7a5b-4d17-8b23-97382992d552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201119472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f751675e-6e24-422e-928d-047182a7cd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb022dc40584772b4685fc590f29ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:50Z,use_quota=True,user_id='21ed62d54db54fabae1451315353d91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c44e237-d2d2-4b03-936d-61b9890c6b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c44e237-d2d2-4b03-936d-61b9890c6b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16d10d1-56a3-44cb-80bb-5a00ab968597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16d10d1-56a3-44cb-80bb-5a00ab968597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f751675e-6e24-422e-928d-047182a7cd7b', 'volume_name': 'volume-f751675e-6e24-422e-928d-047182a7cd7b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980c24fc-64c3-422e-89f7-7d45055f1729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980c24fc-64c3-422e-89f7-7d45055f1729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596ff817-a184-4fb0-b27e-ff25c55e97cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Volume f751675e-6e24-422e-928d-047182a7cd7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f751675e-6e24-422e-928d-047182a7cd7b', 'volume_size': 1} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201119472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f751675e-6e24-422e-928d-047182a7cd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb022dc40584772b4685fc590f29ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:50Z,use_quota=True,user_id='21ed62d54db54fabae1451315353d91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Creating volume f751675e-6e24-422e-928d-047182a7cd7b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:50 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b 1073741824 Sep 25 16:29:50 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b 1073741824" returned: 0 in 0.453s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b Sep 25 16:29:50 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596ff817-a184-4fb0-b27e-ff25c55e97cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f751675e-6e24-422e-928d-047182a7cd7b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d734f46f-6dfb-470a-a6ec-9014cccf5c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Volume volume-f751675e-6e24-422e-928d-047182a7cd7b (f751675e-6e24-422e-928d-047182a7cd7b): created successfully Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d734f46f-6dfb-470a-a6ec-9014cccf5c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Flow 'volume_create_manager' (cc105da3-51f1-4a53-8007-3c777698bb0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4715f9e2-fcb0-44e2-bf45-dc9f16a3315a tempest-ProjectReaderTests-346839777 None] Created volume successfully. Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Acquiring lock "cinder-f751675e-6e24-422e-928d-047182a7cd7b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Lock "cinder-f751675e-6e24-422e-928d-047182a7cd7b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Acquiring lock "cinder-quobyte-f751675e-6e24-422e-928d-047182a7cd7b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Lock "cinder-quobyte-f751675e-6e24-422e-928d-047182a7cd7b" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8944423d-0068-45b7-a94e-f711efd675f8]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[109459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b Sep 25 16:29:52 devstack sudo[109459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[109459]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b Sep 25 16:29:52 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-f751675e-6e24-422e-928d-047182a7cd7b" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Lock "cinder-quobyte-f751675e-6e24-422e-928d-047182a7cd7b" released by "delete_volume" :: held 0.686s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Created reservations ['9c9e4308-36e4-4cc6-ac3e-d0667b6f6fa6', 'cbd05a82-ca07-4d7e-86a8-487d2a489514', '794d2a53-b4a0-4aa9-914f-5d125d3476af', 'e7afb62b-12bc-4531-abf0-aeb33b83fe23'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:29:53 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:53 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Deleted volume successfully. Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62c23c40-9a48-46ad-9c64-29236e6fd07c tempest-ProjectReaderTests-346839777 None] Lock "cinder-f751675e-6e24-422e-928d-047182a7cd7b-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Flow 'volume_create_manager' (5a812a6c-ad21-4cff-9d1d-00bec857ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02d7ee7-6fe1-4fce-93fc-0553cbf539be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02d7ee7-6fe1-4fce-93fc-0553cbf539be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516808061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ebbefa-6c02-4109-998c-51a5f1be9850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb022dc40584772b4685fc590f29ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:54Z,use_quota=True,user_id='21ed62d54db54fabae1451315353d91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34dda12-630d-4d83-aa43-93d9a19d7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34dda12-630d-4d83-aa43-93d9a19d7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea2cd9a-0c8b-4d3b-8952-c2de604fb40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea2cd9a-0c8b-4d3b-8952-c2de604fb40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ebbefa-6c02-4109-998c-51a5f1be9850', 'volume_name': 'volume-00ebbefa-6c02-4109-998c-51a5f1be9850', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5684e494-f329-4314-ba43-2fa85d56a607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5684e494-f329-4314-ba43-2fa85d56a607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fe9f7c-103b-43a0-9fe5-478cc3ce8a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:53 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Volume 00ebbefa-6c02-4109-998c-51a5f1be9850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ebbefa-6c02-4109-998c-51a5f1be9850', 'volume_size': 1} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516808061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ebbefa-6c02-4109-998c-51a5f1be9850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb022dc40584772b4685fc590f29ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:54Z,use_quota=True,user_id='21ed62d54db54fabae1451315353d91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb673c2d-13af-49ed-92b4-b46e16519f30),volume_type_id=cb673c2d-13af-49ed-92b4-b46e16519f30)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Creating volume 00ebbefa-6c02-4109-998c-51a5f1be9850 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Selected osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:53 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] casted to osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99 Sep 25 16:29:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850 1073741824 Sep 25 16:29:53 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850 1073741824" returned: 0 in 0.421s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850 Sep 25 16:29:54 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850" returned: 0 in 0.270s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fe9f7c-103b-43a0-9fe5-478cc3ce8a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ebbefa-6c02-4109-998c-51a5f1be9850', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da60376-b9e0-415d-82cb-32b7e09c683d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Volume volume-00ebbefa-6c02-4109-998c-51a5f1be9850 (00ebbefa-6c02-4109-998c-51a5f1be9850): created successfully Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da60376-b9e0-415d-82cb-32b7e09c683d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Flow 'volume_create_manager' (5a812a6c-ad21-4cff-9d1d-00bec857ee72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-03e744f5-a57d-45ec-a14c-3806d1a5c767 tempest-ProjectReaderTests-346839777 None] Created volume successfully. Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Acquiring lock "cinder-00ebbefa-6c02-4109-998c-51a5f1be9850-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Lock "cinder-00ebbefa-6c02-4109-998c-51a5f1be9850-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Acquiring lock "cinder-quobyte-00ebbefa-6c02-4109-998c-51a5f1be9850" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Lock "cinder-quobyte-00ebbefa-6c02-4109-998c-51a5f1be9850" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c238c-b79f-4a1e-8924-f9afd3152d7e]: (4, 'qcow2') {{(pid=88357) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850 Sep 25 16:29:55 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850" returned: 0 in 0.408s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850 Sep 25 16:29:55 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42/volume-00ebbefa-6c02-4109-998c-51a5f1be9850" returned: 0 in 0.274s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Lock "cinder-quobyte-00ebbefa-6c02-4109-998c-51a5f1be9850" released by "delete_volume" :: held 0.723s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Created reservations ['5efd85f8-3b53-4da2-827e-2285209a7085', '90404bff-a7f4-4099-9d94-1b78253789d6', 'f0397607-e125-4260-840a-16869e50db6c', 'ed0cd53c-2330-4806-8dc0-d29157111ba7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:29:55 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.241s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Deleted volume successfully. Sep 25 16:29:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-62d952c1-abf9-4c63-81ff-044c40db97e1 tempest-ProjectReaderTests-346839777 None] Lock "cinder-00ebbefa-6c02-4109-998c-51a5f1be9850-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e33e206-5049-40b5-8dfa-959fe9d9fe99'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:58 devstack sudo[109500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42 Sep 25 16:29:58 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:58 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/487b4777d75f57711139283a5c779d42" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:29:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8eca192a-ff39-40d3-bac4-c6cdf71e53be None None] thread info: [<_MainThread(MainThread, started 140137634115712)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:30:05 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=31,cinder:UPDATE=42,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:30:06 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=25,cinder:UPDATE=46,cinder:DELETE=6,cinder:INSERT=7 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}